-- Logs begin at Wed 2022-06-22 11:03:53 UTC, end at Wed 2022-06-22 12:15:12 UTC. -- Jun 22 11:36:37.400108 dv-cinder-836973-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 11:36:37.409526 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 11:36:37 2022] *** Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: nodename: dv-cinder-836973-9-iscsi Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: machine: x86_64 Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: clock source: unix Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: pcre jit disabled Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: detected number of CPU cores: 4 Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: current working directory: / Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: detected binary path: /usr/bin/uwsgi-core Jun 22 11:36:37.411599 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: your processes number limit is 47680 Jun 22 11:36:37.412371 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: your memory page size is 4096 bytes Jun 22 11:36:37.412371 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: detected max file descriptor number: 2048 Jun 22 11:36:37.412371 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: lock engine: pthread robust mutexes Jun 22 11:36:37.412371 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: thunder lock: enabled Jun 22 11:36:37.412371 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 11:36:37.412371 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 11:36:37.455270 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: Python main interpreter initialized at 0x559547d3b9c0 Jun 22 11:36:37.455270 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: python threads support enabled Jun 22 11:36:37.455270 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: your server socket listen backlog is limited to 100 connections Jun 22 11:36:37.455270 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: your mercy for graceful operations on workers is 90 seconds Jun 22 11:36:37.455636 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 11:36:37.455719 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: *** Operational MODE: preforking *** Jun 22 11:36:37.455949 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: *** uWSGI is running in multiple interpreter mode *** Jun 22 11:36:37.455949 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: spawned uWSGI master process (pid: 114992) Jun 22 11:36:37.456139 dv-cinder-836973-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 11:36:37.456902 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: spawned uWSGI worker 1 (pid: 114993, cores: 1) Jun 22 11:36:37.458970 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: spawned uWSGI worker 2 (pid: 114994, cores: 1) Jun 22 11:36:37.458970 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 11:36:38.122725 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 11:36:38.135411 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 11:36:39.241827 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 11:36:39.241827 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: from cryptography.utils import int_from_bytes Jun 22 11:36:39.242417 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 11:36:39.242417 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: from cryptography.utils import int_from_bytes Jun 22 11:36:39.246350 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 11:36:39.246350 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: from cryptography.utils import int_from_bytes Jun 22 11:36:39.246820 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 11:36:39.246820 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: from cryptography.utils import int_from_bytes Jun 22 11:36:41.726873 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 11:36:41.727806 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 11:36:41.727932 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 11:36:41.728297 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 11:36:41.728402 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 11:36:41.728495 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 11:36:41.728582 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 11:36:41.728667 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 11:36:41.728776 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 11:36:41.728900 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.728996 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 11:36:41.729085 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.729202 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.729334 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.729523 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.729641 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.729839 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.729936 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.730153 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.730248 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.730481 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.730594 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.730788 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.730891 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.731106 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.731193 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.731395 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.731518 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.731713 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.731807 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.732000 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.732100 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-9-iscsi {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.732318 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.732430 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.732630 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-9-iscsi {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.732781 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.732936 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.733069 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.733241 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.733392 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.733526 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.733619 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.733844 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.734033 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.734123 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.734204 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.734443 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.734625 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.734745 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.735070 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.735335 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.735471 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.735549 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.735724 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.735879 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.736242 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.736334 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.736411 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.736494 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.736634 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.736803 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.736982 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.737074 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.737251 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.737338 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.737573 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.737715 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.737882 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.737976 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.738288 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-9-iscsi {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.738426 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.738605 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.738698 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-9-iscsi {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.738916 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.739003 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.739230 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.739342 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.739586 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.739757 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.739989 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.740078 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.740295 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.740395 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.740598 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.740772 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.740921 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.741056 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.741230 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.741353 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.741527 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.741622 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.741843 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.741941 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.742154 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.742260 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.742556 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.742666 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.742770 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.743599 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.743700 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.743792 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.743925 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.744019 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.744229 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.744317 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.744599 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.744700 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.744840 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.744937 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.745090 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.745183 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.745374 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.745461 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.745674 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.745776 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.745990 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.746090 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.746305 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.746400 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.746560 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.746706 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.746799 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.746893 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.747085 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.747195 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.747422 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.747527 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.747738 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.747834 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.748043 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.748137 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.748345 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.748432 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.748649 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.748742 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.748947 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.749033 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.749249 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.749351 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.749549 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.749644 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.749850 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.749947 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.750150 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.750253 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.750461 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.750554 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.750770 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.750885 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.751074 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.751199 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.751396 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.751495 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.751712 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.751800 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.752037 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.752146 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.752338 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.752431 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.752644 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.752756 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.752974 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.753098 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.753275 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.753369 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.753575 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.753662 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.753888 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.753976 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.754195 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.754288 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.754496 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.754580 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.754795 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.754893 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.755092 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.755185 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.755429 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.755522 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.755751 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.755849 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.756006 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.756092 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.756285 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.756376 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.756582 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.756676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.756881 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.756974 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.757192 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.757285 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.757493 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.757587 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.757794 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.757892 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.758093 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.758195 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.758385 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.758477 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.759248 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.759365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.759576 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.759684 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.759879 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.759967 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.760182 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.760276 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.760486 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.760658 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.760789 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.760880 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.761103 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.761239 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.761391 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.761487 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.761690 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.761777 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.762256 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.762350 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.762560 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.762657 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.762864 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.762950 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.763185 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.763278 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.763491 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.763588 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.763813 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.763924 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.764165 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.764264 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.764402 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.764498 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.764705 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.764792 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.765013 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.765105 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.765330 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.765435 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.765613 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.765708 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.765922 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.766008 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.766242 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.766342 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.766524 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.766620 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.766826 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.766918 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.767124 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.767217 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.767446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.767538 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.767760 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.767849 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.768064 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.768161 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.768361 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.768447 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.768659 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.768825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.768960 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.769055 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.769259 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.769391 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.769559 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.769658 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.769854 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.769982 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.770152 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.770238 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.770444 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.770543 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.770759 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.770857 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.771070 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.771155 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.771393 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.771495 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.771697 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.771782 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.771996 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.772082 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.772312 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:36:41.772408 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.772643 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.772731 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.772969 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.773106 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.773291 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.773382 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.773608 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.773693 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.773936 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.774023 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.774303 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.774396 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.774617 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.774702 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.774927 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.775013 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.775236 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.775323 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.775578 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.775681 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.775886 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.775985 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.776195 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.776289 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.776503 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.776598 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.777066 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.777168 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.777258 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.777334 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.777438 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.777527 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.777749 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.777835 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.778061 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.778163 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.778372 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.778465 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.778677 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.778773 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.778992 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.779095 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.779316 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.779473 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.779647 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.779756 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.779952 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.780093 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.780285 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.780383 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.780625 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.780735 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.780935 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.781035 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.781252 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.781353 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.781562 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.781750 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.781862 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.781954 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.782172 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.782274 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.782474 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.782589 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.782789 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.782892 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.783107 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.783210 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.783429 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.783543 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.783743 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.783845 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.784049 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.784149 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.784353 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.784454 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.784658 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.784765 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.784964 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.785071 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.785270 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.785371 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.785597 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.785707 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.785904 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.786016 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.786216 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.786317 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.786518 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.786620 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.786825 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.786937 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.787128 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.787232 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.787456 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.787559 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.787757 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.787870 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.788056 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.788150 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.788356 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.788445 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.788656 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.788751 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.788960 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.789051 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.789255 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.789347 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.789568 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.789707 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.789914 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.789997 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.790219 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.790318 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.790542 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.790627 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.790841 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.790925 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.791148 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.791235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.791477 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.791614 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.791784 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.791871 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.792082 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.792167 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.792386 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.792472 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.792689 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.792779 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.792987 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.793078 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.793303 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.793396 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.793606 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.793690 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.793906 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.794014 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.794221 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.794316 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.794519 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.794612 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.794819 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.794917 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.795129 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.795213 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.795458 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.795556 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.795769 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.795865 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.796074 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.796165 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.796383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.796479 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.796694 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.796787 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.797003 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.797086 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.797310 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.797395 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.797640 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.797734 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.797947 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.798038 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.798254 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.798339 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.798573 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.798661 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.798885 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.798968 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.799188 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.799273 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.799513 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.799602 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.799818 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.799902 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.800123 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.800208 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.800423 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.800524 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.800721 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.800814 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.801023 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.801115 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.801322 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.801406 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.801621 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.801706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.801919 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.802017 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.802218 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.802303 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.802516 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.802603 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.802829 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.802924 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.803131 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.803223 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.803452 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.803541 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.803753 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.803852 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.804052 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.804144 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.804386 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.804483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.804685 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.804770 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.805021 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.805106 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.805350 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.805935 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.806335 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.806435 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.806515 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.806630 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.806818 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.806940 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.807131 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.807253 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.807463 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.807585 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.807782 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.807893 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.808092 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.808203 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.808410 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.808495 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.808724 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.808823 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.809044 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.809139 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.809354 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.809441 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.809676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.809771 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.809986 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.810081 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.810300 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.810381 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.810606 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.810822 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.810913 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.810991 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.811208 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.811295 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.811567 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.811668 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.811886 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.812018 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.812195 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.812281 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.812504 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.812599 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.812808 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.812899 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.813114 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.813201 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.813417 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.813502 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.813722 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.813807 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.814026 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.814110 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.814332 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.814426 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.814640 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.814724 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.814944 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.815028 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.815257 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.815367 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.815588 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.815673 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.815901 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.815986 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.816218 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.816424 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.816509 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.816744 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.816836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.817050 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.817137 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.817364 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.817451 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.817689 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.817774 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.818018 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.818104 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.818325 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.818414 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.818634 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.818720 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.818949 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.819041 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.819255 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.819343 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.819584 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.819668 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.819912 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.820057 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.820192 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.820286 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.820500 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.820596 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.820808 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.820903 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.821658 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.821762 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.821975 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.822082 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.822289 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.822379 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.822601 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.822695 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.822905 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.822999 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.823210 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.823300 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.823540 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.823640 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.823844 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.823939 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.824154 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.824240 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.824474 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.824577 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.824853 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.824962 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.825085 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.825170 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.825387 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.825472 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.825687 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.825773 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.825987 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.826079 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.826296 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.826382 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.826599 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.826693 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.826899 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.826989 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.827199 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.827285 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.827521 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.827620 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.827863 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.828017 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.828164 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.828304 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.828439 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.828530 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.828752 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.828851 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.829070 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.829178 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.829375 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.829471 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.829681 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.829775 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.829986 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.830114 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.830292 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.830395 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.830599 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.830700 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.830908 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.831006 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.831214 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.831318 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.831544 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.831643 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.831853 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.831968 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.832156 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.832246 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.832462 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.832557 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.832867 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.832965 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.833072 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.833170 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.833372 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.833463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.833674 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.833766 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.833972 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.834064 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.834279 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.834563 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.834662 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.834968 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.835137 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.835254 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.835488 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.835591 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.835801 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.835886 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.836114 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.836201 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.836429 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.836523 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.836800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.836891 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.837125 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.837211 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.837447 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.837541 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.837784 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.837881 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.838085 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.838173 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.838392 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.838478 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.838692 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.838782 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.838993 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.839087 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.839297 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.839409 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.839625 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.839719 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.839925 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.840022 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.840229 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.840349 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.840532 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.840638 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.840835 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.840930 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.841139 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.841240 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.841437 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.841547 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.841739 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.841834 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.842049 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.842150 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.842349 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.842446 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.842655 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.842741 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.842955 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.843041 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.843260 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.843429 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.843588 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.843673 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.843888 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.843987 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.844189 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.844291 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.844487 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.844574 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.844822 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.844909 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.845122 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.845217 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.845456 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.845541 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.845775 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.845870 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.846081 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.846173 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.846396 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.846480 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.846698 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.846792 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.847001 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.847086 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.847303 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.847421 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.847629 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.847724 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.847930 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.848017 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.848231 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.848324 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.848534 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.848627 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.848835 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.848921 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.849142 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.849241 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.849444 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.849529 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.849744 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.849835 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.850048 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.850140 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.850353 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.850473 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.850662 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.850777 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.850964 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.851066 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.851263 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.851398 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.851587 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.851683 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.851886 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.851984 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.852191 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.852802 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.853024 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.853160 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.853333 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.853489 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.853625 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.853758 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.853926 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.854067 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.854211 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.854356 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.854518 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.854653 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.854819 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.854951 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.855121 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.855264 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.855432 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.855519 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.855739 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.855825 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.856040 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.856142 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.856342 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.856429 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.856642 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.856727 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.856943 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.857030 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.857241 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.857327 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.857541 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.857626 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.857840 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.857926 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.858138 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.858222 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.858438 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.858523 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.858743 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.858831 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.859050 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.859142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.859411 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.859502 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.859683 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.859775 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.859984 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.860076 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.860284 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.860378 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.860590 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.860685 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.860897 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.861026 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.861191 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.861290 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.861488 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.861573 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.861787 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.861872 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.862086 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.862184 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.862383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.862470 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.862681 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.862767 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.862988 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.863081 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.863289 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.863393 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.863615 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.863701 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.863913 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.864001 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.864209 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.864294 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.864547 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.864633 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.864848 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.864941 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.865183 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.865268 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.865490 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.865592 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.865801 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.865888 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.866111 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.866194 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.866415 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.866505 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.866718 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.866804 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.867025 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.867117 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.867325 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.867441 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.867656 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.867744 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.868008 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.868099 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.868315 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.868413 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.868612 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.868696 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.868909 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.868994 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.869226 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.869320 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.869533 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.869618 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.869838 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.869923 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.870154 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.870249 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.870458 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.870549 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.870768 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.870864 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.871077 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.871172 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.871404 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.871493 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.871717 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.871810 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.872018 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.872105 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.872323 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.872408 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.872628 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.872721 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.872934 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.873061 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.873241 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.873327 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.873549 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.873633 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.873852 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.873938 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.874157 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.874241 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.874458 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.874543 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.874761 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.874846 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.875063 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.875161 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.875388 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.875491 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.875699 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.875784 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.876002 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.876085 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.876302 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.876399 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.876603 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.876688 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.876902 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.876994 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.877205 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.877331 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.877504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.877640 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.877931 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.878016 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.878239 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.878333 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.878543 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.878628 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.878844 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.878929 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.879149 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.879235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.879477 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.879584 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.879781 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.879866 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.880089 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.880198 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.880390 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.880511 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.880799 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.880893 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.881111 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.881241 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.881414 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.881499 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.881718 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.881805 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.882016 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.882101 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.882314 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.882407 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.882620 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.882718 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.882925 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.883017 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.883225 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.883325 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.884069 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.884180 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.884370 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.884463 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.884688 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.884773 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.884987 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.885084 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.885303 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.885389 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.885688 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.885781 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.886003 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.886096 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.886304 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.886390 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.886691 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.886782 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.887260 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.887410 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.887594 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.887692 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.887913 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.887997 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.888220 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.888307 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.888534 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.888644 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.888901 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.889093 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.889183 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.889270 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.889430 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.889517 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.889748 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.889834 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.890064 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.890149 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.890365 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.890451 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.890677 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.890776 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.890974 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.891068 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.891287 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.891412 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.891633 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.891817 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.891938 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.892033 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.892252 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.892339 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.892648 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.892762 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.892961 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.893065 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.893265 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.893363 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.893579 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.893669 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.893883 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.893985 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.894188 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.894290 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.894534 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.894637 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.894781 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.894879 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.895077 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.895192 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.895412 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.895498 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.895703 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.895793 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.896003 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.896092 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.896313 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.896422 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.896611 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.896701 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.896913 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.896999 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.897209 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.897296 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.897508 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.897597 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.897825 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.897912 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.898125 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.898220 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.898441 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.898536 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.898750 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.898837 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.899052 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.899205 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.899933 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.900022 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.900237 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.900325 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.900540 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.900646 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.900845 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.900985 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.901141 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.901228 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.901439 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.901541 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.901742 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.901830 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.902074 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.902170 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.902371 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.902467 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.902686 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.902820 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.903007 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.903095 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.903329 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.903443 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.903657 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.903757 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.903985 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.904071 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.904303 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.904394 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.904613 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.904700 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.904920 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.905006 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.905223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.905313 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.905524 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.905611 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.905821 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.905909 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.906122 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.906209 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.906419 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.906506 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.906717 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.906815 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.907015 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.907111 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.907314 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.907435 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.907635 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.907742 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.907932 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.908019 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.908228 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.908316 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.908542 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.908643 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.908841 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.908929 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.909141 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.909228 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.909445 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.909541 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.909742 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.909828 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.910039 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.910126 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.910336 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.910431 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.910677 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.910776 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.910981 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.911070 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.911299 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.911407 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.911643 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.911734 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.911949 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.912096 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.912272 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.912362 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.912575 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.912671 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.912888 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.912985 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.913199 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.913294 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.913511 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.913607 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.913823 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.913920 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.914132 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.914219 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.914442 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.914574 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.914766 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.914871 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.915077 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.915164 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.915401 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.915504 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.915714 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.915811 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.916024 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.916268 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.916357 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.916596 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.916863 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.916960 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.917185 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.917274 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.917496 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.917584 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.917803 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.917892 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.918111 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.918200 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.918420 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.918507 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.918724 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.918819 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.919029 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.919118 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.919336 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.919436 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.919664 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.919753 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.919970 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.920059 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.920291 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.920387 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.920606 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.920703 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.920924 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.921013 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.921238 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.921347 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.921551 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.921640 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.921857 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.921952 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.922165 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.922263 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.922472 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.922568 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.922808 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.922895 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.923117 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.923211 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.923441 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.923534 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.923753 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.923864 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.924063 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.924150 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.924371 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.924458 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.924677 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.924773 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.924984 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.925085 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.925290 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.925378 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.925598 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.925703 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.925904 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.925991 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.926213 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.926291 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.926521 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.926609 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.926832 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.926910 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.927152 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.927230 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.927486 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.927567 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.927803 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.928229 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.928394 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.928474 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.928645 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.928809 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.931324 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.931489 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.931598 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.931688 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.931782 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.931865 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.931946 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932037 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932120 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932211 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932294 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932375 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932444 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932524 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932591 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932695 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932784 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932860 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.932941 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933009 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933083 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933160 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933229 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933296 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933361 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933428 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933494 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933582 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933723 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933812 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933893 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.933974 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.934105 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.934196 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.934449 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.934643 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.934785 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.934991 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.935273 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.935412 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.935649 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.935741 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.935959 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.936046 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.936280 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.936376 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.936590 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.936678 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.936901 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.936988 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.937205 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.937294 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.937507 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.937593 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.937808 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.937900 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.939566 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.939773 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.940015 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.940174 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.940337 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.940499 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.940649 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.940795 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.940947 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.941092 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.941235 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.941388 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.941572 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.941732 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.941874 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.942016 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.942159 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.942312 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943000 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943089 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943170 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943258 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943482 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943572 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943652 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943731 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943808 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.943943 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944028 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944115 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944202 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944282 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944368 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944460 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944540 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944618 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944701 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944779 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944897 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.944992 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945074 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945152 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945237 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945317 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945404 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945484 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945563 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945641 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945719 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945797 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945884 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.945964 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.946596 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.946733 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.946876 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.946996 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.947096 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.947178 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.947256 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.947335 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.947450 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.947616 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.947834 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.947958 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.948046 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.948272 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.948365 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.948618 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.948706 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.948934 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.949019 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.949252 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.949476 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.949790 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.949878 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.950115 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.950199 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.950449 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.950534 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.950778 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.950865 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.951086 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.951172 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.951424 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.951513 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.951730 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.951817 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.952033 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.952126 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.952349 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.952442 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.952656 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.952752 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.952962 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.953047 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.953268 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.953366 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.953581 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.953669 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.953891 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.954012 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.954197 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.954291 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.954503 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.954589 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.954810 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.954933 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.955114 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.955205 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.955441 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.955531 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.955748 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.955835 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.956054 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.956141 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.956358 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.956444 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.956667 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.956760 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.957001 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.957087 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.957312 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.957403 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.957622 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.957721 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.957933 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.958019 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.958240 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.958324 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.958543 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.958638 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.958847 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.958933 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.959148 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.959234 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.959478 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.959589 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.959790 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.959878 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.960103 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.960189 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.960408 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.960503 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.960709 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.960829 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.961128 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.961216 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.961442 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.961530 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.962293 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.962397 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.962615 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.962701 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.962922 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.963054 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.963243 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.963550 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.963649 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.963824 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.963913 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.964162 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.964264 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.964491 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.964590 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.964815 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.965150 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.965311 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.965402 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.965492 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.965770 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.965874 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.966072 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.966159 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.966379 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.966542 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.966676 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.966854 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.966981 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.967164 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.967297 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.967501 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.967628 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.967824 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.967931 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.968137 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.968227 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.968445 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.968545 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.968752 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.968856 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.969064 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.969157 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.969369 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.969464 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.969673 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.969758 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.969976 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.970273 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.970366 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.970573 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.970659 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.970872 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.970959 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.971170 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.971264 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.971493 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.971583 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.971791 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.971887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.972092 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.972178 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.972388 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.972479 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.972688 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.972826 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.972988 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.973074 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.973285 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.973369 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.973583 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.973670 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.973883 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.973976 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.974189 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.974312 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.974521 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.974632 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.974836 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.974934 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.975142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.975263 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.975481 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.975603 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.975784 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.975873 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.976100 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.976188 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.976414 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.976511 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.976723 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.976811 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.977077 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.977172 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.977877 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.978066 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.978217 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.978364 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.978501 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.978635 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.978781 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.978917 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.979082 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.979224 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.979408 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.979500 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.979719 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.979816 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.980028 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.980115 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.980340 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.980427 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.980642 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.980728 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.980963 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.981051 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.981265 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.981358 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.981583 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.981675 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.981896 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.981982 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.982200 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.982293 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.982513 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.982598 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.982817 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.982949 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.983122 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.983218 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.983454 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.983545 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.983762 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.983850 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.984068 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.984164 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.984379 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.984493 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.984683 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.984770 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.984994 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.985081 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.985312 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.985428 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.985616 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.985712 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.985938 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.986042 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.986245 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.986341 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.986570 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.986672 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.986881 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.986978 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.987222 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.987326 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.987554 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.987661 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.987876 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.987971 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.988184 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.988286 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.988485 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.988589 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.988726 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 11:36:41.988823 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.989097 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:36:41.989343 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 11:36:42.052319 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO dbcounter [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Registered counter for database nova_api Jun 22 11:36:42.145007 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO dbcounter [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Registered counter for database nova_api Jun 22 11:36:42.165352 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_db.sqlalchemy.engines [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:36:42.166913 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:36:42.172025 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writer thread running {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:36:42.173470 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writer thread running {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:36:42.228974 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.context [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),18a4207f-37f5-4279-abf2-4a3e89b4b2e4(cell1) {{(pid=114993) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 11:36:42.231953 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.context [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),18a4207f-37f5-4279-abf2-4a3e89b4b2e4(cell1) {{(pid=114994) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 11:36:42.233795 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:36:42.235398 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:36:42.235652 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG oslo_concurrency.lockutils [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:36:42.236179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:36:42.237236 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG oslo_concurrency.lockutils [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:36:42.238037 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG oslo_concurrency.lockutils [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:36:42.238339 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:36:42.240046 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG oslo_concurrency.lockutils [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:36:42.240346 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO dbcounter [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Registered counter for database nova_cell0 Jun 22 11:36:42.242334 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO dbcounter [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Registered counter for database nova_cell0 Jun 22 11:36:42.244277 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO dbcounter [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Registered counter for database nova_cell1 Jun 22 11:36:42.246542 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO dbcounter [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Registered counter for database nova_cell1 Jun 22 11:36:42.251718 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_db.sqlalchemy.engines [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:36:42.253882 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_db.sqlalchemy.engines [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:36:42.256267 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:36:42.258343 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:36:42.258957 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writer thread running {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:36:42.263956 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writer thread running {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:36:42.265227 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writer thread running {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:36:42.266142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writer thread running {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:36:42.412859 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO dbcounter [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Registered counter for database nova_cell0 Jun 22 11:36:42.416327 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO dbcounter [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Registered counter for database nova_cell0 Jun 22 11:36:42.422229 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:36:42.425313 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_db.sqlalchemy.engines [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:36:42.426907 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writer thread running {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:36:42.429606 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writer thread running {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:36:42.762761 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: WARNING keystonemiddleware.auth_token [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 11:36:42.765094 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: WARNING keystonemiddleware.auth_token [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 11:36:42.769903 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: WARNING keystonemiddleware.auth_token [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 11:36:42.772326 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: WARNING keystonemiddleware.auth_token [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 11:36:43.107809 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: WARNING keystonemiddleware.auth_token [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 11:36:43.110889 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: WARNING keystonemiddleware.auth_token [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 11:36:43.113565 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: WARNING keystonemiddleware.auth_token [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 11:36:43.116856 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: WARNING keystonemiddleware.auth_token [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 11:36:43.118751 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559547d3b9c0 pid: 114994 (default app) Jun 22 11:36:43.120845 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:36:43.121922 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559547d3b9c0 pid: 114993 (default app) Jun 22 11:36:43.122016 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-a5b401d8-b8e8-4888-8680-2f22fcd261df None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Jun 22 11:36:43.122408 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed Jun 22 11:36:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:01.072903 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:01.074660 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002537 Jun 22 11:38:01.075378 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:01.094134 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writing DB stats nova_api:SELECT=3 {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:01.096000 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writing DB stats nova_cell0:SELECT=3 {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:01.096723 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writing DB stats nova_cell1:SELECT=3 {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:01.097557 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:01.602185 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-f9eb1eb9-1d0e-4101-8747-5312ad7a1983 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:01.634213 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-f9eb1eb9-1d0e-4101-8747-5312ad7a1983 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.549540 Jun 22 11:38:01.635076 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jun 22 11:38:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:38:03.747337 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:03.748427 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-a6bb3e99-a587-4b14-b022-1b3f89691713 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 22 11:38:03.748811 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:03.813669 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-44846965-5d3d-480d-ad29-77c33d3f7ca2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "id": "c1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:03.835600 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 11:38:03.835600 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: warnings.warn(msg) Jun 22 11:38:03.866492 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-44846965-5d3d-480d-ad29-77c33d3f7ca2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111482 Jun 22 11:38:03.867909 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 11:38:03.883010 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_api:SELECT=3 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:03.884622 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_cell1:SELECT=3 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:03.886017 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_cell0:SELECT=3 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:03.886954 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:04.094192 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-9b6d6913-5bf4-476f-9e5e-788c63bd2103 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:04.096540 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 11:38:04.096540 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: warnings.warn(msg) Jun 22 11:38:04.159268 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-9b6d6913-5bf4-476f-9e5e-788c63bd2103 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282847 Jun 22 11:38:04.160093 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 11:38:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:38:06.282472 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-44846965-5d3d-480d-ad29-77c33d3f7ca2 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:06.283587 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-44846965-5d3d-480d-ad29-77c33d3f7ca2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 22 11:38:06.284162 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:06.389962 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-bc75691a-6ed1-4cd9-9a3e-0c2efe938b10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "name": "ds512M", "vcpus": 1}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:06.407710 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 11:38:06.407710 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: warnings.warn(msg) Jun 22 11:38:06.433473 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-bc75691a-6ed1-4cd9-9a3e-0c2efe938b10 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143086 Jun 22 11:38:06.434258 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:38:06.446304 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-399da1f3-0be7-4ce9-a0a5-e9cbc0b300ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:06.447820 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 11:38:06.447820 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: warnings.warn(msg) Jun 22 11:38:06.479686 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-399da1f3-0be7-4ce9-a0a5-e9cbc0b300ca admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037035 Jun 22 11:38:06.480242 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 11:38:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:38:08.610983 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-bc75691a-6ed1-4cd9-9a3e-0c2efe938b10 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:08.612030 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-bc75691a-6ed1-4cd9-9a3e-0c2efe938b10 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 22 11:38:08.612436 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:08.678458 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-dc4e73f2-e5b4-4f4f-ab40-9d3e929b8510 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2", "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:08.698664 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-dc4e73f2-e5b4-4f4f-ab40-9d3e929b8510 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080090 Jun 22 11:38:08.699723 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:38:08.712669 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-ed8e5051-b613-4479-805f-7326c39e86f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:08.742379 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-ed8e5051-b613-4479-805f-7326c39e86f1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033477 Jun 22 11:38:08.755379 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 11:38:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:38:10.872925 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-dc4e73f2-e5b4-4f4f-ab40-9d3e929b8510 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:10.873923 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-dc4e73f2-e5b4-4f4f-ab40-9d3e929b8510 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 22 11:38:10.874336 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:38:10.936973 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-8b380091-a3ab-4772-9924-a076b09f6ce5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "vcpus": 2}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:10.954946 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-8b380091-a3ab-4772-9924-a076b09f6ce5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074696 Jun 22 11:38:10.955612 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 11:38:10.967723 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-72411fdd-4155-4397-a099-efdc442fdbfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:10.988985 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-72411fdd-4155-4397-a099-efdc442fdbfb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024910 Jun 22 11:38:10.989719 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 11:38:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:38:13.078921 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-8b380091-a3ab-4772-9924-a076b09f6ce5 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:13.079966 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-8b380091-a3ab-4772-9924-a076b09f6ce5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 22 11:38:13.080372 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:13.138593 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-bf9bd6ea-feda-470e-9dc6-596bc8df5cca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:13.160276 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-bf9bd6ea-feda-470e-9dc6-596bc8df5cca admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073631 Jun 22 11:38:13.160938 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 11:38:13.176100 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-a61377f4-fb54-44fe-8065-ea16730ffb8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:13.199970 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-a61377f4-fb54-44fe-8065-ea16730ffb8e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030544 Jun 22 11:38:13.200485 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 11:38:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:38:15.311487 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-bf9bd6ea-feda-470e-9dc6-596bc8df5cca admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:15.312676 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-bf9bd6ea-feda-470e-9dc6-596bc8df5cca admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Jun 22 11:38:15.313238 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:15.377279 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-85724284-7329-4830-9a11-815e2eff2850 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:15.403521 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-85724284-7329-4830-9a11-815e2eff2850 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084032 Jun 22 11:38:15.415960 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jun 22 11:38:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:38:17.616341 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-bf9bd6ea-feda-470e-9dc6-596bc8df5cca admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:17.617363 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-bf9bd6ea-feda-470e-9dc6-596bc8df5cca admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 22 11:38:17.617771 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:17.706113 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-8ac4fe88-6ccf-406d-9bf3-0ce95b660678 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:17.728801 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-8ac4fe88-6ccf-406d-9bf3-0ce95b660678 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.104221 Jun 22 11:38:17.729563 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:38:17.746171 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-1d7df6dd-bb1b-4103-b82d-08527dd8b37e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:17.775166 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-1d7df6dd-bb1b-4103-b82d-08527dd8b37e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035478 Jun 22 11:38:17.776189 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 11:38:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:38:19.890281 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-8ac4fe88-6ccf-406d-9bf3-0ce95b660678 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:19.891630 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-8ac4fe88-6ccf-406d-9bf3-0ce95b660678 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Jun 22 11:38:19.892184 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:19.967071 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-6d1c4d3d-fcfe-4535-a3d1-6de669820d82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2"}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:19.988090 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-6d1c4d3d-fcfe-4535-a3d1-6de669820d82 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087849 Jun 22 11:38:19.988800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:38:20.002379 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-89b37c22-27d2-44a7-98f4-4c15b1aaffe2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:20.026838 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-89b37c22-27d2-44a7-98f4-4c15b1aaffe2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027999 Jun 22 11:38:20.027471 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 11:38:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:38:22.213636 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-6d1c4d3d-fcfe-4535-a3d1-6de669820d82 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:22.214920 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-6d1c4d3d-fcfe-4535-a3d1-6de669820d82 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Jun 22 11:38:22.215458 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:22.283987 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-cb28db94-7402-431c-9056-a941f4ddff59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:22.301772 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-cb28db94-7402-431c-9056-a941f4ddff59 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079090 Jun 22 11:38:22.302327 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 11:38:22.314212 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-296b127d-af81-49d2-9ba9-82a2997ee4bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:22.338504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-296b127d-af81-49d2-9ba9-82a2997ee4bc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027927 Jun 22 11:38:22.339076 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 11:38:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:38:24.565147 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-cb28db94-7402-431c-9056-a941f4ddff59 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:24.566184 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-cb28db94-7402-431c-9056-a941f4ddff59 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 22 11:38:24.566583 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:24.626144 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-146b8939-4392-40c7-a4ba-1fbad8cca38d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "id": "4", "name": "m1.large"}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:24.646143 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-146b8939-4392-40c7-a4ba-1fbad8cca38d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073010 Jun 22 11:38:24.647084 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 11:38:24.659000 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-0b055344-ad68-40c9-b93d-ca3a6120e046 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:24.681465 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-0b055344-ad68-40c9-b93d-ca3a6120e046 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026119 Jun 22 11:38:24.682039 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 11:38:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:38:26.797434 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-146b8939-4392-40c7-a4ba-1fbad8cca38d admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:26.798457 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-146b8939-4392-40c7-a4ba-1fbad8cca38d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 22 11:38:26.798854 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:26.868615 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-751c5eda-ef4c-42d5-8b01-4529ac511fa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:26.886097 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-751c5eda-ef4c-42d5-8b01-4529ac511fa6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080864 Jun 22 11:38:26.886924 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 11:38:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:38:26.899515 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-cf84906d-1df3-4d99-9ac9-86a3a8951d7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:26.928976 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-cf84906d-1df3-4d99-9ac9-86a3a8951d7b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033678 Jun 22 11:38:26.946385 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 11:38:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:38:51.665690 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-751c5eda-ef4c-42d5-8b01-4529ac511fa6 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:51.666698 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-751c5eda-ef4c-42d5-8b01-4529ac511fa6 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 22 11:38:51.667090 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:51.677648 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:51.726061 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-e66e26f5-5135-40df-a8bc-c44c79ec36c2 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:51.742615 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-e66e26f5-5135-40df-a8bc-c44c79ec36c2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069542 Jun 22 11:38:51.743134 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jun 22 11:38:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:38:52.656195 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-751c5eda-ef4c-42d5-8b01-4529ac511fa6 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:52.660119 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-751c5eda-ef4c-42d5-8b01-4529ac511fa6 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Jun 22 11:38:52.660523 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:38:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:52.850760 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-202b4463-08ca-4e29-a138-7eeba48aa442 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:52.856388 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.wsgi [None req-202b4463-08ca-4e29-a138-7eeba48aa442 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-202b4463-08ca-4e29-a138-7eeba48aa442 admin admin] Request method failure captured: Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Accept: application/json Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Accept-Encoding: gzip, deflate Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Connection: keep-alive Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Content-Length: 0 Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Host: 10.222.0.36 Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Openstack-Api-Version: compute 2.90 Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Openstack-System-Scope: None Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: User-Agent: python-novaclient Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Auth-Token: gAAAAABisv9MzvjCui1L5-NDz2OkFs2zAh0L6r9RZZo2-NWfFwALmC58HiBBcphsH6Rk3JCwECQ2HSOmcwbvP6iKJRSFsjq-b6EaEbbrL3JuNOHZWxAoN2cHKE4mzKnYBLZN03NKeNHKeCrFtmIaSxfIBYXQkeLvMEIfPVFZMfbwzlQSNXBY2QY Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Domain-Id: None Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Domain-Name: None Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Identity-Status: Confirmed Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Is-Admin-Project: True Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Domain-Id: default Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Domain-Name: Default Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Name: admin Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Role: admin,reader,member Jun 22 11:38:52.859631 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Roles: admin,reader,member Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c77776cd83344a69a0a4fbb7efadd00f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant: admin Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant-Name: admin Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User: admin Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Domain-Id: default Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Domain-Name: Default Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Id: 8441761690594b9d8a423147d5d6d62d Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Name: admin Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: method: > Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: exception: Flavor 42 could not be found. Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: action_args: {'id': '42'} Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:38:52.861504 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:52.862463 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.863800 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-202b4463-08ca-4e29-a138-7eeba48aa442 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:38:52.865028 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-202b4463-08ca-4e29-a138-7eeba48aa442 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061571 Jun 22 11:38:52.865028 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jun 22 11:38:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 11:38:52.870667 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-bef453a1-5c3b-4f89-932f-56d959ec4ec9 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:52.873554 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:38:52.894021 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-bef453a1-5c3b-4f89-932f-56d959ec4ec9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026798 Jun 22 11:38:52.894614 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 11:38:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:38:52.905057 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-5c0bfb03-679d-4123-a345-673de5a57929 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:52.927317 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-5c0bfb03-679d-4123-a345-673de5a57929 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025798 Jun 22 11:38:52.927906 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 11:38:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:38:52.938219 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-5001de19-a326-402e-b0ad-962ade26486a admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:52.945585 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.wsgi [None req-5001de19-a326-402e-b0ad-962ade26486a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-5001de19-a326-402e-b0ad-962ade26486a admin admin] Request method failure captured: Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Accept: application/json Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Accept-Encoding: gzip, deflate Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Connection: keep-alive Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Content-Length: 0 Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Host: 10.222.0.36 Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Openstack-Api-Version: compute 2.90 Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Openstack-System-Scope: None Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: User-Agent: python-novaclient Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Auth-Token: gAAAAABisv9MzvjCui1L5-NDz2OkFs2zAh0L6r9RZZo2-NWfFwALmC58HiBBcphsH6Rk3JCwECQ2HSOmcwbvP6iKJRSFsjq-b6EaEbbrL3JuNOHZWxAoN2cHKE4mzKnYBLZN03NKeNHKeCrFtmIaSxfIBYXQkeLvMEIfPVFZMfbwzlQSNXBY2QY Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Domain-Id: None Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Domain-Name: None Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Identity-Status: Confirmed Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Is-Admin-Project: True Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Domain-Id: default Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Domain-Name: Default Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Name: admin Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Role: admin,reader,member Jun 22 11:38:52.948836 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Roles: admin,reader,member Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c77776cd83344a69a0a4fbb7efadd00f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant: admin Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant-Name: admin Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User: admin Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Domain-Id: default Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Domain-Name: Default Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Id: 8441761690594b9d8a423147d5d6d62d Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Name: admin Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: method: > Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: exception: Flavor 42 could not be found. Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: action_args: {'id': '42'} Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:38:52.950365 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:52.951179 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:52.952235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-5001de19-a326-402e-b0ad-962ade26486a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:38:52.953246 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-5001de19-a326-402e-b0ad-962ade26486a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016466 Jun 22 11:38:52.953246 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jun 22 11:38:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 11:38:53.778264 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-5c0bfb03-679d-4123-a345-673de5a57929 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:53.779254 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-5c0bfb03-679d-4123-a345-673de5a57929 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 22 11:38:53.779680 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:38:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:53.968740 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-e49ab369-8157-4f74-8107-e727c9ce8930 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:53.974340 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.wsgi [None req-e49ab369-8157-4f74-8107-e727c9ce8930 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-e49ab369-8157-4f74-8107-e727c9ce8930 admin admin] Request method failure captured: Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Accept: application/json Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Accept-Encoding: gzip, deflate Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Connection: keep-alive Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Content-Length: 0 Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Host: 10.222.0.36 Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Openstack-Api-Version: compute 2.90 Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Openstack-System-Scope: None Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: User-Agent: python-novaclient Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Auth-Token: gAAAAABisv9NeJjKk3YRUG33ON9vsLrrhFWemp6UMQTP1s42ySAfh3fI4LMY2XOSL7sqDB8FrlzwDTBXl0r3_fC-CP_mw9roktvasF9MxPE1LUIJTMZCszrGhOAUfcda75aAxDAC1j6jWayPoSad0IjPYXYtQ73KpavPqSIRZzTc33e9L2AtmI8 Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Domain-Id: None Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Domain-Name: None Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Identity-Status: Confirmed Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Is-Admin-Project: True Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Domain-Id: default Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Domain-Name: Default Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Name: admin Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Role: admin,reader,member Jun 22 11:38:53.975887 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Roles: admin,reader,member Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c77776cd83344a69a0a4fbb7efadd00f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant: admin Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant-Name: admin Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User: admin Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Domain-Id: default Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Domain-Name: Default Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Id: 8441761690594b9d8a423147d5d6d62d Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Name: admin Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: method: > Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: exception: Flavor 84 could not be found. Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: action_args: {'id': '84'} Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:38:53.977706 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:53.978676 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:53.980223 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-e49ab369-8157-4f74-8107-e727c9ce8930 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:38:53.981350 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-e49ab369-8157-4f74-8107-e727c9ce8930 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061245 Jun 22 11:38:53.981350 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jun 22 11:38:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 11:38:53.987512 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-c18ba56f-e19a-40e7-810f-7acd8e0852fa admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:54.001633 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-c18ba56f-e19a-40e7-810f-7acd8e0852fa admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017673 Jun 22 11:38:54.002184 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 11:38:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:38:54.012384 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-7a3c5c80-8333-4f67-9c8a-b58380815578 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:54.026237 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-7a3c5c80-8333-4f67-9c8a-b58380815578 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017413 Jun 22 11:38:54.026759 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 11:38:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:38:54.035970 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-b04700e5-04d0-4243-847e-42882553af35 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:54.041452 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.wsgi [None req-b04700e5-04d0-4243-847e-42882553af35 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-b04700e5-04d0-4243-847e-42882553af35 admin admin] Request method failure captured: Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Accept: application/json Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Accept-Encoding: gzip, deflate Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Connection: keep-alive Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Content-Length: 0 Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Host: 10.222.0.36 Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Openstack-Api-Version: compute 2.90 Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Openstack-System-Scope: None Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: User-Agent: python-novaclient Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Auth-Token: gAAAAABisv9NeJjKk3YRUG33ON9vsLrrhFWemp6UMQTP1s42ySAfh3fI4LMY2XOSL7sqDB8FrlzwDTBXl0r3_fC-CP_mw9roktvasF9MxPE1LUIJTMZCszrGhOAUfcda75aAxDAC1j6jWayPoSad0IjPYXYtQ73KpavPqSIRZzTc33e9L2AtmI8 Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Domain-Id: None Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Domain-Name: None Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Identity-Status: Confirmed Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Is-Admin-Project: True Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Domain-Id: default Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Domain-Name: Default Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Name: admin Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Role: admin,reader,member Jun 22 11:38:54.042951 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Roles: admin,reader,member Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c77776cd83344a69a0a4fbb7efadd00f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant: admin Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant-Name: admin Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User: admin Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Domain-Id: default Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Domain-Name: Default Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Id: 8441761690594b9d8a423147d5d6d62d Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Name: admin Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: method: > Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: exception: Flavor 84 could not be found. Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: action_args: {'id': '84'} Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:38:54.044486 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:54.045383 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:54.046469 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-b04700e5-04d0-4243-847e-42882553af35 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:38:54.047585 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-b04700e5-04d0-4243-847e-42882553af35 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011989 Jun 22 11:38:54.047585 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jun 22 11:38:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 11:38:54.866488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-7a3c5c80-8333-4f67-9c8a-b58380815578 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:54.867556 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-7a3c5c80-8333-4f67-9c8a-b58380815578 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 22 11:38:54.867947 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:55.059253 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-9f7e65ac-bd59-4d14-9995-e2a1b2c9046e admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:55.065002 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.wsgi [None req-9f7e65ac-bd59-4d14-9995-e2a1b2c9046e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-9f7e65ac-bd59-4d14-9995-e2a1b2c9046e admin admin] Request method failure captured: Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Accept: application/json Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Accept-Encoding: gzip, deflate Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Connection: keep-alive Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Content-Length: 0 Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Host: 10.222.0.36 Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Openstack-Api-Version: compute 2.90 Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Openstack-System-Scope: None Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: User-Agent: python-novaclient Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Auth-Token: gAAAAABisv9O5q08eeSF7Ly2L3C-_qqPaDO8kRZRAsanoTVXRvfAjSXz-CseZROKkrSSX9gIoGTnl3VvH6gDCHaQuD67VXFhijdZEuD9LhlxLJGexk0pnsrMT5o5fIHgbMc9LRVMpP1A4rUMwjH2CF0H-PPZgIi6xFFkVAUhdaxAS7pCpGAGQ0g Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Domain-Id: None Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Domain-Name: None Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Identity-Status: Confirmed Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Is-Admin-Project: True Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Domain-Id: default Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Domain-Name: Default Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Project-Name: admin Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Role: admin,reader,member Jun 22 11:38:55.066483 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Roles: admin,reader,member Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c77776cd83344a69a0a4fbb7efadd00f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant: admin Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-Tenant-Name: admin Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User: admin Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Domain-Id: default Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Domain-Name: Default Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Id: 8441761690594b9d8a423147d5d6d62d Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: X-User-Name: admin Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: method: > Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: exception: Flavor 451 could not be found. Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: action_args: {'id': '451'} Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:38:55.068142 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:55.069120 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.070446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-9f7e65ac-bd59-4d14-9995-e2a1b2c9046e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:38:55.071799 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-9f7e65ac-bd59-4d14-9995-e2a1b2c9046e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059775 Jun 22 11:38:55.071799 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 11:38:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 11:38:55.077471 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-423316b3-fedb-42db-b093-55a82fb65cf6 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:55.091464 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-423316b3-fedb-42db-b093-55a82fb65cf6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017464 Jun 22 11:38:55.091982 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 11:38:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:38:55.101857 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:55.116091 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018158 Jun 22 11:38:55.116654 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 11:38:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:38:55.126014 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-2de164cd-7e9e-47a0-bd19-807e5a83038e admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:55.131460 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.wsgi [None req-2de164cd-7e9e-47a0-bd19-807e5a83038e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-2de164cd-7e9e-47a0-bd19-807e5a83038e admin admin] Request method failure captured: Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Accept: application/json Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Accept-Encoding: gzip, deflate Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Connection: keep-alive Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Content-Length: 0 Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Host: 10.222.0.36 Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Openstack-Api-Version: compute 2.90 Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Openstack-System-Scope: None Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: User-Agent: python-novaclient Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Auth-Token: gAAAAABisv9O5q08eeSF7Ly2L3C-_qqPaDO8kRZRAsanoTVXRvfAjSXz-CseZROKkrSSX9gIoGTnl3VvH6gDCHaQuD67VXFhijdZEuD9LhlxLJGexk0pnsrMT5o5fIHgbMc9LRVMpP1A4rUMwjH2CF0H-PPZgIi6xFFkVAUhdaxAS7pCpGAGQ0g Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Domain-Id: None Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Domain-Name: None Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Identity-Status: Confirmed Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Is-Admin-Project: True Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Domain-Id: default Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Domain-Name: Default Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Project-Name: admin Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Role: admin,reader,member Jun 22 11:38:55.132940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Roles: admin,reader,member Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c77776cd83344a69a0a4fbb7efadd00f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c77776cd83344a69a0a4fbb7efadd00f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant: admin Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant-Id: c77776cd83344a69a0a4fbb7efadd00f Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-Tenant-Name: admin Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User: admin Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Domain-Id: default Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Domain-Name: Default Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Id: 8441761690594b9d8a423147d5d6d62d Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: X-User-Name: admin Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: method: > Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: exception: Flavor 451 could not be found. Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: action_args: {'id': '451'} Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:38:55.134423 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:55.135488 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: ERROR nova.api.openstack.wsgi Jun 22 11:38:55.136825 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-2de164cd-7e9e-47a0-bd19-807e5a83038e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:38:55.138293 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-2de164cd-7e9e-47a0-bd19-807e5a83038e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011844 Jun 22 11:38:55.138293 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 11:38:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 11:38:55.967080 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:55.968148 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 22 11:38:55.968568 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:56.158696 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-4bf4a2d2-b3d0-4cff-8d6a-718503c17798 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:56.177765 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-4bf4a2d2-b3d0-4cff-8d6a-718503c17798 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070691 Jun 22 11:38:56.178232 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jun 22 11:38:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 11:38:56.995446 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:56.996615 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Jun 22 11:38:56.997008 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:38:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:57.183702 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-cbb62e9f-1eb1-4748-880d-e2ef942e6a1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:57.206096 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-cbb62e9f-1eb1-4748-880d-e2ef942e6a1f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072751 Jun 22 11:38:57.207165 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jun 22 11:38:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:38:58.049166 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:58.050191 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 22 11:38:58.050599 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:38:58.241831 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-423e8359-f038-49ed-bdab-3af8f05ef416 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:58.258485 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-423e8359-f038-49ed-bdab-3af8f05ef416 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067950 Jun 22 11:38:58.259030 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jun 22 11:38:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:38:59.087536 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:38:59.088543 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 22 11:38:59.088941 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:38:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:38:59.289355 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-68dd65d1-8b09-4e01-b3a2-95abb1028f6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:38:59.307907 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-68dd65d1-8b09-4e01-b3a2-95abb1028f6f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078958 Jun 22 11:38:59.308464 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jun 22 11:38:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:39:00.128296 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:39:00.129288 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 22 11:39:00.129673 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:39:00.319815 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-11d5215d-3cbd-4a4d-b5c7-4a2fda46f2d5 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:39:00.338505 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-11d5215d-3cbd-4a4d-b5c7-4a2fda46f2d5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069950 Jun 22 11:39:00.339044 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed Jun 22 11:39:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:39:47.729368 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:39:47.730380 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-0a6adc22-3bf8-4e8c-bf42-2c3d0696fc1b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 22 11:39:47.730794 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 11:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:39:47.742090 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:39:47.801054 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-4e940779-acb3-4cad-a9c1-d8655d55bb72 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:39:47.821004 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-4e940779-acb3-4cad-a9c1-d8655d55bb72 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.083460 Jun 22 11:39:47.821582 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jun 22 11:39:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:39:47.845464 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-34475f4c-3fc9-4829-87c6-7322105554f9 admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:39:47.849745 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG dbcounter [-] [114994] Writing DB stats nova_api:SELECT=14 {{(pid=114994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:39:47.855579 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-34475f4c-3fc9-4829-87c6-7322105554f9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013626 Jun 22 11:39:47.856162 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Jun 22 11:39:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:39:47.868309 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-d29dd5e0-a890-472f-98c0-31401b0a0670 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:39:47.876604 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-d29dd5e0-a890-472f-98c0-31401b0a0670 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011884 Jun 22 11:39:47.877281 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Jun 22 11:39:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:39:47.890104 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:39:47.899017 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012761 Jun 22 11:39:47.899608 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Jun 22 11:39:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:39:47.911864 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-8aef8433-657d-487a-abf2-05579e74d435 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:39:47.919919 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-8aef8433-657d-487a-abf2-05579e74d435 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011723 Jun 22 11:39:47.920489 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Jun 22 11:39:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:43:06.170893 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:43:06.171942 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 22 11:43:06.172343 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:43:06.315162 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_api:SELECT=6 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:43:06.429235 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-f81f8796-2676-4e5f-90d7-ad6e3c48abb9 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:43:06.430466 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 11:43:06.430466 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: warnings.warn(msg) Jun 22 11:43:06.431691 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f81f8796-2676-4e5f-90d7-ad6e3c48abb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:43:06.432134 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f81f8796-2676-4e5f-90d7-ad6e3c48abb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:43:06.432940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f81f8796-2676-4e5f-90d7-ad6e3c48abb9 admin admin] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:43:06.433367 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f81f8796-2676-4e5f-90d7-ad6e3c48abb9 admin admin] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:43:06.469257 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-f81f8796-2676-4e5f-90d7-ad6e3c48abb9 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155519 Jun 22 11:43:06.469834 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 11:43:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:43:07.300020 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:43:07.301046 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 22 11:43:07.301464 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:43:07.495993 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-f624aa0f-51e1-4705-a870-362408d523d2 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:43:07.497152 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 11:43:07.497152 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: warnings.warn(msg) Jun 22 11:43:07.498322 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f624aa0f-51e1-4705-a870-362408d523d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:43:07.498773 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f624aa0f-51e1-4705-a870-362408d523d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:43:07.499583 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f624aa0f-51e1-4705-a870-362408d523d2 admin admin] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:43:07.500014 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f624aa0f-51e1-4705-a870-362408d523d2 admin admin] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:43:07.520798 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-f624aa0f-51e1-4705-a870-362408d523d2 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075812 Jun 22 11:43:07.521297 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 11:43:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:43:18.776648 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:43:18.777639 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 22 11:43:18.778027 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:43:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:43:18.925844 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_cell0:SELECT=4 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:43:18.926560 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_cell1:SELECT=4 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:43:18.927316 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG dbcounter [-] [114993] Writing DB stats nova_api:SELECT=8 {{(pid=114993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:43:18.977076 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-f0d15850-e31f-4726-a55a-7350491e6c68 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:43:18.978227 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 11:43:18.978227 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: warnings.warn(msg) Jun 22 11:43:18.979450 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f0d15850-e31f-4726-a55a-7350491e6c68 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:43:18.979891 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f0d15850-e31f-4726-a55a-7350491e6c68 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:43:18.980661 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f0d15850-e31f-4726-a55a-7350491e6c68 admin admin] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:43:18.981086 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f0d15850-e31f-4726-a55a-7350491e6c68 admin admin] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:43:19.005288 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-f0d15850-e31f-4726-a55a-7350491e6c68 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083834 Jun 22 11:43:19.005764 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 11:43:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:43:19.835579 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: DEBUG nova.api.openstack.wsgi [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] Calling method '>' {{(pid=114994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:43:19.836723 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: INFO nova.api.openstack.requestlog [None req-b9abd2ca-a40e-459a-9efd-6a799ee659bf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 22 11:43:19.837012 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: [pid: 114994|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 11:43:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:43:20.039513 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG nova.api.openstack.wsgi [None req-f4270bc1-6495-4fcf-8765-d489e624b9b6 admin admin] Calling method '>' {{(pid=114993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:43:20.040674 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 11:43:20.040674 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: warnings.warn(msg) Jun 22 11:43:20.041846 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f4270bc1-6495-4fcf-8765-d489e624b9b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:43:20.042286 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f4270bc1-6495-4fcf-8765-d489e624b9b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:43:20.043064 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f4270bc1-6495-4fcf-8765-d489e624b9b6 admin admin] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:43:20.043525 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: DEBUG oslo_concurrency.lockutils [None req-f4270bc1-6495-4fcf-8765-d489e624b9b6 admin admin] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:43:20.064752 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: INFO nova.api.openstack.requestlog [None req-f4270bc1-6495-4fcf-8765-d489e624b9b6 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077461 Jun 22 11:43:20.065236 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: [pid: 114993|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 11:43:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:44:17.938318 dv-cinder-836973-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 11:44:17.941165 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: Wed Jun 22 11:44:17 2022 - graceful shutdown triggered... Jun 22 11:44:17.941596 dv-cinder-836973-9-iscsi devstack@n-api.service[114994]: Gracefully killing worker 2 (pid: 114994)... Jun 22 11:44:17.941940 dv-cinder-836973-9-iscsi devstack@n-api.service[114993]: Gracefully killing worker 1 (pid: 114993)... Jun 22 11:44:18.942268 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: worker 1 buried after 1 seconds Jun 22 11:44:18.942268 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: worker 2 buried after 1 seconds Jun 22 11:44:18.942268 dv-cinder-836973-9-iscsi devstack@n-api.service[114992]: goodbye to uWSGI. Jun 22 11:44:18.943842 dv-cinder-836973-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 11:44:18.944392 dv-cinder-836973-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 11:44:18.947192 dv-cinder-836973-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 11:44:18.959934 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 11:44:18 2022] *** Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: nodename: dv-cinder-836973-9-iscsi Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: machine: x86_64 Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: clock source: unix Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: pcre jit disabled Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: detected number of CPU cores: 4 Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: current working directory: / Jun 22 11:44:18.961776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: detected binary path: /usr/bin/uwsgi-core Jun 22 11:44:18.962530 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: your processes number limit is 47680 Jun 22 11:44:18.962530 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: your memory page size is 4096 bytes Jun 22 11:44:18.962530 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: detected max file descriptor number: 2048 Jun 22 11:44:18.962530 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: lock engine: pthread robust mutexes Jun 22 11:44:18.962530 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: thunder lock: enabled Jun 22 11:44:18.962530 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 11:44:18.962530 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 11:44:19.009032 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: Python main interpreter initialized at 0x5646c36f19c0 Jun 22 11:44:19.009032 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: python threads support enabled Jun 22 11:44:19.009032 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: your server socket listen backlog is limited to 100 connections Jun 22 11:44:19.009032 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: your mercy for graceful operations on workers is 90 seconds Jun 22 11:44:19.009570 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 11:44:19.009570 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: *** Operational MODE: preforking *** Jun 22 11:44:19.009885 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: *** uWSGI is running in multiple interpreter mode *** Jun 22 11:44:19.009885 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: spawned uWSGI master process (pid: 129507) Jun 22 11:44:19.010132 dv-cinder-836973-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 11:44:19.010776 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: spawned uWSGI worker 1 (pid: 129527, cores: 1) Jun 22 11:44:19.011288 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: spawned uWSGI worker 2 (pid: 129528, cores: 1) Jun 22 11:44:19.011624 dv-cinder-836973-9-iscsi devstack@n-api.service[129507]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 11:44:19.678436 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 11:44:19.687180 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 11:44:20.889934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 11:44:20.889934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: from cryptography.utils import int_from_bytes Jun 22 11:44:20.890671 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 11:44:20.890671 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: from cryptography.utils import int_from_bytes Jun 22 11:44:20.903491 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 11:44:20.903491 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: from cryptography.utils import int_from_bytes Jun 22 11:44:20.904094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 11:44:20.904094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: from cryptography.utils import int_from_bytes Jun 22 11:44:23.288577 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 11:44:23.289187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 11:44:23.289372 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 11:44:23.289932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 11:44:23.290367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 11:44:23.290939 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.291479 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.291958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.292433 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.292959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.293287 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.293625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.293955 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.294298 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.294560 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.294890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.295218 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-9-iscsi {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.295576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.295895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.296231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.296560 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.297053 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.297385 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.297697 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.298213 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.300091 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.300431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.300741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.301284 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.301614 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.301946 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.302276 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.302575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.302911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.303234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.303703 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-9-iscsi {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.304013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.304323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.304632 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.305061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.305385 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.305704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.306013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.306345 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.306653 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.306981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.307323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.307655 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.307975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.308280 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.308598 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.308910 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.309228 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.309534 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.309857 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.312619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.312619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.312619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.312619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.312619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.312619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.312619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.313171 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.313171 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.313171 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.313171 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.313465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.313775 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.313942 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.314325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.314638 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.314960 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.315314 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.315676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.315997 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.316783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.316783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.317023 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.317275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.317580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.317991 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.318441 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.318601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.318857 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.319183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.319528 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.319838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.320148 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.320468 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.320792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.321096 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.321348 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.321652 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.321978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.322260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.322622 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.322864 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.323199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.323631 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.323942 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.324273 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.324582 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.324895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.325197 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.325509 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.325819 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.326126 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.326431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.326754 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.327072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.327419 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.327713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.327877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 11:44:23.328424 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.328581 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 11:44:23.328730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.328885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 11:44:23.329032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.329220 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 11:44:23.329417 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.329603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 11:44:23.329782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.329957 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.331556 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.331664 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.331740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.331811 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.331888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.331975 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332047 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332124 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332406 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332498 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332582 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.332808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.333061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.333182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.333311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.333433 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.333628 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.333729 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.334033 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.334138 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.334342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.334442 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-9-iscsi {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.334649 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.334773 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.334959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.335191 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.335282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.335576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.335685 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.335883 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.336042 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.336208 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.336350 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.336529 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.336687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.336838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.336999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.337144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.337448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.337537 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.337772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.337892 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.338111 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.338220 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.338420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.338519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.338758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.338859 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.339073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.339176 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.339402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.339510 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.339747 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.339856 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.340052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.340149 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.340367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.340495 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.340682 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.340843 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.341006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.341106 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-9-iscsi {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.341316 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.341435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.341627 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.341716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.341937 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.342037 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.342253 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.342381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.342597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.342697 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.342902 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.343008 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.343209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.343299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.343599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.343711 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.343867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.343965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.344178 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.344276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.344494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.344584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.344821 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.344911 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.345137 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.345233 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.345440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.345535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.345752 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.345868 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.346060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.346172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.346375 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.346533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.347285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.347464 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.347693 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.347861 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.347998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.348135 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.348278 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.348441 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.348587 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.348735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.348875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.349019 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.349170 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.349322 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.349416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.349500 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.349590 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.349750 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.349864 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.350062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.350183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.350374 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.350489 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.350683 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.350797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.350996 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.351158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.351290 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.351528 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.351651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.351763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.352019 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.352116 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.352271 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.352388 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.352615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.352723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.352890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.352977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.353200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.353287 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.353518 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.353827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.354143 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.354276 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.354559 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.354639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.354810 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.354921 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.355116 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.355234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.355480 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.355568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.355914 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.356008 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.356088 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.356179 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.356505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.356599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.356724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.356814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.357029 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.357116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.357340 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.357432 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.357635 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.357892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.358151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.358469 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.358779 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.359091 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.359225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.359437 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.359620 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.359755 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.359947 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.360064 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.360212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.360392 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.360526 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.360713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.360886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.361070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.361241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.361442 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.361594 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.361748 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.361892 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.362043 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.362222 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.362364 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.362513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.362664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.362814 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.362916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.363048 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.363196 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.363379 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.363606 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.363923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.364219 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.364527 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.364632 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.364832 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.364940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.365144 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.365351 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.365546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.365640 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.365768 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.365859 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.366074 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.366206 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.366399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.366525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.366695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.366863 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.366999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.367199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.367531 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.367641 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.367848 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.367953 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.368162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.368277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.368470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.368572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.368782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.368897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.369088 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.369193 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.369399 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.369520 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.369703 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.369817 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.370011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.370113 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.370315 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.370434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.370619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.370717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.370929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.371042 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.371252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.371590 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.371898 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.372239 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.372548 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.372869 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.373176 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.373527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.373868 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.374193 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.374544 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.374839 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.375154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.377715 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.377864 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.377964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.378087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.378183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.378278 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.378424 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.378424 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.378589 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.378673 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.378756 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.378927 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.379021 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.379104 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.379190 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.379273 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.379386 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.379482 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.379581 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.379671 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.379755 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.379836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.379918 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.380008 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.380008 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.380177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.380267 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.380357 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.380453 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.380563 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.380675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.380760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.380850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.380934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 11:44:23.381062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.381210 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.381512 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.381614 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.381724 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.381823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.381996 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.382181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.382342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.382500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.382653 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.382804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.382960 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.383103 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.383250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.383486 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.383664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.383869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.384016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.384157 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.384304 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.384445 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.384602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.384758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.384902 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.385042 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.385182 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.385371 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.385526 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.385704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.385862 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.386012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.386161 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.386311 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.386463 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.386617 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.386758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.386922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.387079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.387221 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.387426 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.388109 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.388218 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.388312 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.388675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.388777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.388874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.388959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.389051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.389141 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.389232 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.389323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.389417 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.389501 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.390164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.390383 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.390543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.390682 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.390826 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.390975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.390975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.391255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.391425 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.391602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.391752 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.391881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.392025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.392458 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.392607 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.392743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.392994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.393125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.393253 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.393877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.394038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.394201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.394451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.394753 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.394909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.395045 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.395222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.395570 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.395742 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.395926 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.396066 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.396194 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.396344 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.396505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.396652 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.396802 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.396941 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.397091 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.397251 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.397406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.397544 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.397672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.397810 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.397945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.398106 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.398253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.398380 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.398521 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.398662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.398807 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.398976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.399134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.399267 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.399551 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.399692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.399831 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.399969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.399969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.400202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.400367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.400367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.400367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.400753 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.400882 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.400882 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.401125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.401268 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.401408 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.401565 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.401720 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.401867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.402011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.402154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.402314 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.402454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.402596 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.402751 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.402906 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.403062 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.403191 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.403329 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.403480 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.403656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.403800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.403999 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.404282 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.404412 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.404639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.404874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.405014 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.405293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.405462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.405609 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.405897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.406090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.406232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.406494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.406639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.406807 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.407072 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.407203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.407329 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.407587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.407738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.407882 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.408030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.408336 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.408496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.408643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.408791 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.408933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.408933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.409774 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.409918 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.410073 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.410229 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.410376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.410544 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.410697 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.410957 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.411052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.411281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.411431 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.411625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.411778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.411907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.412052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.412208 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.412369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.412511 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.412705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.412860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.412999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.413198 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.413345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.413475 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.413604 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.413780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.413915 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.414093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.414225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.414439 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.414564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.414772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.414869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.415064 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.415163 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.415410 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.415569 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.415721 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.415810 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.416026 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.416135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.416337 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.416449 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.416646 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.416743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.416950 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.417039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.417266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.417363 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.417576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.417685 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.417886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.417995 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.418197 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.418288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.418599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.418728 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.418814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.418886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.419133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.419225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.419446 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.419559 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.419746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.419898 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.420014 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.420222 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.420317 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.420505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.420602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.420817 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.420923 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.421137 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.421244 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.421459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.421558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.421789 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.421894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.422104 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.422218 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.422412 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.422511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.422730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.422840 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.423018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.423120 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.423330 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.423450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.423639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.423739 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.423934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.424039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.424259 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.424367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.424571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.424693 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.424905 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.425001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.425209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.425312 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.425520 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.425614 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.425825 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.425927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.426129 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.426234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.426439 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.426533 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.426761 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.426863 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.427077 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.427172 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.427398 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.427506 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.427710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.427806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.428015 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.428110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.428321 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.428430 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.428625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.428727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.428932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.429034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.429234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.429337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.429533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.429629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.429841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.429944 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.430146 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.430253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.430449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.430551 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.430772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.430867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.431083 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.431188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.431404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.431515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.431768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.431877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.432002 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.432083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.432382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.432487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.432649 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.432757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.432984 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.433090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.433315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.433409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.433600 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.433699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.433917 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.434014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.434229 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.434336 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.434543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.434648 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.434852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.434951 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.435155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.435254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.435493 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.435604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.435802 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.435983 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.436117 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.436295 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.436431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.436612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.436712 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.436939 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.437078 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.437253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.437393 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.437578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.437710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.437906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.438046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.438216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.438356 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.438525 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.438700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.438830 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.438979 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.439139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.439276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.439539 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.439678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.439807 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.439933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.440059 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.440221 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.440436 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.440580 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.440709 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.440843 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.441009 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.441151 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.441323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.441455 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.441638 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.441864 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.442003 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.442141 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.442269 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.442404 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.442541 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.442669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.442838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.442984 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.443147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.443287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.443498 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.443640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.443812 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.443951 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.444117 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.444255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.444428 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.444568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.444736 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.444876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.445047 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.445186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.445353 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.445488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.445796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.445935 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.446109 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.446239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.446421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.446560 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.446769 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.446906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.447033 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.447159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.447321 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.447535 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.447670 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.447958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.448097 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.448260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.448440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.448603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.448733 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.448927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.449059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.449252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.449384 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.449572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.449703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.449882 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.450021 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.450188 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.450327 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.450497 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.450635 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.450822 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.450971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.451127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.451259 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.451457 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.451611 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.451748 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.451902 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.452111 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.452250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.452386 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.452524 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.452659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.452797 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.452934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.453072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.453252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.453390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.453562 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.453701 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.453872 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.454070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.454202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.454385 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.454529 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.454698 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.454865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.455022 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.455153 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.455420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.455573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.455710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.456371 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.456519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.456654 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.456816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.456956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.457127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.457260 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.457449 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.457578 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.457759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.457890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.458072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.458215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.458385 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.458517 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.458693 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.458833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.459017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.459148 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.459340 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.459502 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.459675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.459808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.459998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.460129 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.460330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.460472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.460640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.460778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.460948 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.461086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.461257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.461403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.461573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.461704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.461883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.462015 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.462228 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.462368 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.462503 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.462629 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.462792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.462929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.463105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.463243 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.463439 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.463572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.463746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.463882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.464055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.464183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.464363 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.464533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.464670 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.464808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.464966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.465098 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.465272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.465403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.465578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.465717 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.465888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.466018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.466199 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.466329 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.466509 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.466650 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.466824 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.466964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.467133 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.467272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.467460 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.467591 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.467777 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.467909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.468086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.468215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.468390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.468535 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.468695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.468827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.468998 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.469136 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.469302 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.469445 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.469630 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.469771 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.469946 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.470085 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.470257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.470401 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.470567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.470706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.470880 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.471012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.471189 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.471329 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.471571 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.472235 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.472432 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.472564 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.472701 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.472838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.473018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.473150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.473327 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.473467 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.473643 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.473782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.473951 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.474092 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.474255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.474385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.474561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.474691 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.474868 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.474997 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.475173 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.475451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.475585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.475721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.475849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.475976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.476103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.476243 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.476379 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.476506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.476686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.476822 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.477001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.477141 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.477308 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.477438 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.477614 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.477751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.477916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.478063 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.478219 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.478350 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.478561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.478690 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.478867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.479004 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.479202 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.479335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.479555 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.479699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.479880 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.480013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.480200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.480343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.480518 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.480657 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.480821 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.480962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.481129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.481307 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.481461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.481600 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.481753 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.481893 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.482070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.482201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.482381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.482598 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.482729 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.482865 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.482992 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.483125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.483293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.483510 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.483648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.483783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.483940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.484069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.484259 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.484390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.484587 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.484831 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.484970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.485162 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.485307 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.485478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.485618 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.485791 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.485922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.486103 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.486234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.486414 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.486547 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.486723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.486897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.487035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.487210 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.487384 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.487528 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.487694 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.487833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.488005 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.488138 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.488315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.488451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.488630 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.488807 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.488946 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.489086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.489240 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.489378 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.489570 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.489712 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.489881 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.490019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.490188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.490318 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.490500 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.490639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.491060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.491501 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.491640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.491769 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.491911 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.492041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.492041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.493061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.493200 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.493337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.493475 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.493603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.493731 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.493858 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.493986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.494119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.494261 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.494389 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.494523 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.494650 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.494785 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.494928 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.495057 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.495192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.495327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.495479 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.495608 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.495754 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.495891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.496022 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.496158 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.496286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.496421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.496602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.496740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.496875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.497010 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.497139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.497277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.497492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.497492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.497735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.497861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.497987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.498124 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.498252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.498386 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.498514 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.498650 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.498777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.498912 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.499040 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.499167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.499293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.499452 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.499589 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.499725 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.499861 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.499998 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.500134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.500272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.500413 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.500549 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.500678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.500854 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.500986 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.501179 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.501321 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.501493 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.501625 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.501800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.501932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.502120 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.502266 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.502431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.502564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.502833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.503063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.503212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.503393 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.503538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.503675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.503803 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.504005 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.504152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.504332 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.504465 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.504652 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.504784 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.504963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.505103 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.505289 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.505428 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.505598 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.505737 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.505905 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.506050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.506223 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.506362 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.506538 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.506669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.506844 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.506985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.507153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.507285 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.507491 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.507632 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.507802 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.507934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.508109 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.508241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.508421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.508553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.508724 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.508863 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.509054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.509192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.509363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.509495 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.509670 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.509802 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.509977 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.510116 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.510298 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.510429 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.510610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.510779 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.510916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.511045 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.511201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.511390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.511522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.511662 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.511837 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.511969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.512144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.512290 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.512457 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.512623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.512752 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.512880 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.513067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.513306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.513447 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.513575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.513702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.513829 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.514018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.514161 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.514326 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.514466 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.514638 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.514775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.514943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.515075 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.515372 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.515514 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.515643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.515770 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.515918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.516056 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.516214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.516355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.516527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.516658 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.516879 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.517013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.517454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.517597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.517825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.519315 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.519579 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.519722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.519852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.519980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.520108 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.520251 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.520380 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.520507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.520634 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.520768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.520897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521034 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521165 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521421 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521827 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521957 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.521957 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.522216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.522216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.522475 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.522613 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.522741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.522875 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.523004 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.523139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.523298 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.523526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.523658 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.523798 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.523934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.524061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.524198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.524327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.524466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.524594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.524727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.524902 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.525077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.525208 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.525337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.525576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.525708 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.525845 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.525981 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.526109 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.526236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.526363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.526498 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.526718 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.526848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.526975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.527102 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.527246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.527568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.527713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.527841 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.527969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.528095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.528220 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.528355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.528499 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.528665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.528796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.528935 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.529073 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.529209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.529338 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.529522 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.529819 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.529951 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.530134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.530401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.530540 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.530733 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.530873 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.531053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.531193 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.531386 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.531521 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.531707 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.531851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.532019 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.532165 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.532336 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.532466 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.532644 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.532775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.532956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.533100 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.533270 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.533470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.533710 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.533846 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.534029 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.534673 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.534806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.534945 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.535074 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.535207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.535401 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.535551 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.535783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.535926 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.536063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.536201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.536351 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.536487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.536614 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.536749 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.536879 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.537044 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.537189 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.537364 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.537503 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.537675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.537815 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.537994 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.538134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.538316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.538449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.538634 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.538763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.538936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.539077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.539240 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.539407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.539571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.539711 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.539875 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.540008 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.540179 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.540311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.540485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.540631 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.540801 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.540939 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.541102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.541239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.541406 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.541552 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.541709 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.541841 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.542014 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.542162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.542316 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.542458 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.542652 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.542784 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.542986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.543125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.543304 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.543648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.543876 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.544007 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.544132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.544268 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.544408 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.544564 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.544730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.544888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.545027 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.545210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.545352 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.545527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.545669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.545888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.546019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.546155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.546296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.546450 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.546589 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.546762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.546899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.547073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.547211 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.547396 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.547546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.547708 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.547847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.548020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.548152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.548328 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.548459 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.548654 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.548785 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.548956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.549086 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.549282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.549553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.549727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.549937 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.550076 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.550253 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.550384 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.550565 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.550703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.550899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.551030 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.551207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.551336 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.551551 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.551681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.551846 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.551985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.552155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.552286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.552465 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.552596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.552778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.552917 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.553092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.553231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.553415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.553543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.553724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.553870 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.554068 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.554205 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.554341 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.554481 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.554640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.554772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.554956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.555087 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.555267 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.555439 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.555628 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.555760 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.555974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.556121 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.556257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.556474 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.556608 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.556731 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.556858 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.556984 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.557117 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 11:44:23.557257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.557447 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.557757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.558067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.558385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.558693 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.559006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.559314 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.559651 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.559963 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.560279 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.560639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.560967 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.561279 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.561587 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.561909 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.562225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.562554 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.562996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.563188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.564256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.564256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.564568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.564761 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.565089 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.565461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.565801 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.566116 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.566425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.566736 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.567066 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.567399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.567717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.568032 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.568351 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.568665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.568974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.569287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.569601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.569914 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.570234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.570545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.570852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.571171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.571513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.571860 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.572183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.572504 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.572823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.573140 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.573453 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.573768 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.574082 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.574398 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.574716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.575049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.575386 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.575738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.576236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.576556 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.576881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.577206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.577521 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.577847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.578174 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.578490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.578816 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.579132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.579500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.579849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.580184 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.580519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.581352 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.581675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.581987 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.582301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.582626 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.582939 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.583246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.583579 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.583896 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.584886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.584886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.584886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.585358 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.585504 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.585744 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.586053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.586362 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.586670 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.587013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.587283 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.587739 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.588069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.588402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.588712 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.589023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.589333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.589674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.590013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.590338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.590700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.591025 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.591372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.591689 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.592018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.592348 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.592673 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.592990 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.593328 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.593642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.593961 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.594277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.594760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.594931 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.599490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.599490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.599490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.599490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.599490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.599490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.599490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.599490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600697 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.600782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.601124 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.601405 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.601716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.602045 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.602375 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.602731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.603050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.603420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.604506 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.604506 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.604506 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.604747 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 11:44:23.604908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 11:44:23.619430 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO dbcounter [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Registered counter for database nova_api Jun 22 11:44:23.640392 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_db.sqlalchemy.engines [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:44:23.648878 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writer thread running {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:44:23.668451 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO dbcounter [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Registered counter for database nova_api Jun 22 11:44:23.689989 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_db.sqlalchemy.engines [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:44:23.699191 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writer thread running {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:44:23.715313 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.context [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),18a4207f-37f5-4279-abf2-4a3e89b4b2e4(cell1) {{(pid=129527) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 11:44:23.721406 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:44:23.723098 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:44:23.723975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:44:23.725963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:44:23.728054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO dbcounter [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Registered counter for database nova_cell0 Jun 22 11:44:23.732367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO dbcounter [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Registered counter for database nova_cell1 Jun 22 11:44:23.739875 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_db.sqlalchemy.engines [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:44:23.742154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_db.sqlalchemy.engines [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:44:23.747373 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writer thread running {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:44:23.749954 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writer thread running {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:44:23.764055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.context [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),18a4207f-37f5-4279-abf2-4a3e89b4b2e4(cell1) {{(pid=129528) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 11:44:23.769093 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:44:23.770715 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:44:23.771656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:44:23.775206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:44:23.776239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO dbcounter [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Registered counter for database nova_cell0 Jun 22 11:44:23.780545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO dbcounter [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Registered counter for database nova_cell1 Jun 22 11:44:23.788531 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_db.sqlalchemy.engines [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:44:23.789971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_db.sqlalchemy.engines [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:44:23.797163 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writer thread running {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:44:23.798585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writer thread running {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:44:23.904633 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO dbcounter [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Registered counter for database nova_cell0 Jun 22 11:44:23.911945 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_db.sqlalchemy.engines [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:44:23.919001 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writer thread running {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:44:23.959269 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO dbcounter [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Registered counter for database nova_cell0 Jun 22 11:44:23.967232 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_db.sqlalchemy.engines [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 11:44:23.972203 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writer thread running {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 11:44:24.264688 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: WARNING keystonemiddleware.auth_token [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 11:44:24.272492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: WARNING keystonemiddleware.auth_token [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 11:44:24.299164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: WARNING keystonemiddleware.auth_token [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 11:44:24.307373 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: WARNING keystonemiddleware.auth_token [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 11:44:24.619478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: WARNING keystonemiddleware.auth_token [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 11:44:24.625625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: WARNING keystonemiddleware.auth_token [None req-3306be9d-aa1f-4df9-96e9-0c9c398c7ca3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 11:44:24.632065 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646c36f19c0 pid: 129527 (default app) Jun 22 11:44:24.650536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: WARNING keystonemiddleware.auth_token [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 11:44:24.656534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: WARNING keystonemiddleware.auth_token [None req-dbdc1012-652b-48ce-8bc1-35ef614733e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 11:44:24.662732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646c36f19c0 pid: 129528 (default app) Jun 22 11:45:05.593478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=3 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:05.603449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=3 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:05.604892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=3 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:05.605967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=3 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:05.949306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:05.953561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:05.955751 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:05.958343 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:07.832195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d0503896-91e3-4353-8298-315b6b37b84c tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Action: 'create', calling method: .version_select at 0x7f3ea921d790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1778174913", "metadata": {"Type": "work"}}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:08.309354 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1c0de846-a059-4c5b-91e4-00d9e82979e3 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Action: 'create', calling method: .version_select at 0x7f3ea921d790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1299180244", "metadata": {"Type": "work"}}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1c0de846-a059-4c5b-91e4-00d9e82979e3 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Request method failure captured: Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 122 Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDBRziIQmO50w_7b0Tq7OeRxXX8CMH_xf7DcS8GDY0mVTulgF6EojwuMnROQkf9Gv65zW1EQRNuSly8xZrML6w764luMnFdiGVFbx5PRi367xIC9X2FlXVlc2wD29KWOIHGNFWtVaAmxNlFUCEf_heMiepWCLqaPCgiRqm5XU3DyLM Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:45:08.336713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_57c834b746fc4a11aa0226019923d4d0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 60c13dd599844219a310f5eb222ef41f Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1299180244", "metadata": {"Type": "work"}}} Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: Jun 22 11:45:08.338096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1299180244', 'metadata': {'Type': 'work'}}}} Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise error Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:45:08.338922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 11:45:08.340288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 11:45:08.341461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 11:45:08.341461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.341461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1c0de846-a059-4c5b-91e4-00d9e82979e3 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:45:08.341461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1c0de846-a059-4c5b-91e4-00d9e82979e3 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.405637 Jun 22 11:45:08.341461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jun 22 11:45:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2407 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 11:45:08.349337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a29c2189-ac29-40f2-aaa3-653a5956b870 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Action: 'create', calling method: .version_select at 0x7f3ea9191a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1798578492", "metadata": {"Type": "work"}}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a29c2189-ac29-40f2-aaa3-653a5956b870 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Request method failure captured: Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 120 Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDBRziIQmO50w_7b0Tq7OeRxXX8CMH_xf7DcS8GDY0mVTulgF6EojwuMnROQkf9Gv65zW1EQRNuSly8xZrML6w764luMnFdiGVFbx5PRi367xIC9X2FlXVlc2wD29KWOIHGNFWtVaAmxNlFUCEf_heMiepWCLqaPCgiRqm5XU3DyLM Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:45:08.352049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_57c834b746fc4a11aa0226019923d4d0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 60c13dd599844219a310f5eb222ef41f Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1798578492", "metadata": {"Type": "work"}}} Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: Jun 22 11:45:08.353330 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1798578492', 'metadata': {'Type': 'work'}}}} Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise error Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi '0' Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:45:08.354105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 11:45:08.355391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 11:45:08.356476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 11:45:08.356476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.356476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a29c2189-ac29-40f2-aaa3-653a5956b870 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:45:08.356476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a29c2189-ac29-40f2-aaa3-653a5956b870 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008224 Jun 22 11:45:08.356476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jun 22 11:45:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 11:45:08.363452 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2c462388-4d4c-4f35-90d0-cb1d8d8cc8c2 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Action: 'create', calling method: .version_select at 0x7f3ea921daf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-945005825", "metadata": {"Type": "work"}}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2c462388-4d4c-4f35-90d0-cb1d8d8cc8c2 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Request method failure captured: Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 118 Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDBRziIQmO50w_7b0Tq7OeRxXX8CMH_xf7DcS8GDY0mVTulgF6EojwuMnROQkf9Gv65zW1EQRNuSly8xZrML6w764luMnFdiGVFbx5PRi367xIC9X2FlXVlc2wD29KWOIHGNFWtVaAmxNlFUCEf_heMiepWCLqaPCgiRqm5XU3DyLM Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:45:08.365782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_57c834b746fc4a11aa0226019923d4d0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 60c13dd599844219a310f5eb222ef41f Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-945005825", "metadata": {"Type": "work"}}} Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: Jun 22 11:45:08.367177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-945005825', 'metadata': {'Type': 'work'}}}} Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise error Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi '' Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:45:08.367971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 11:45:08.369250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 11:45:08.370317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 11:45:08.370317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:08.370317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2c462388-4d4c-4f35-90d0-cb1d8d8cc8c2 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:45:08.370317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2c462388-4d4c-4f35-90d0-cb1d8d8cc8c2 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007564 Jun 22 11:45:08.378431 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 3/3] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jun 22 11:45:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 11:45:08.387683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-714e9efb-b6a1-4371-b5e5-81d26049d202 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Calling method '.version_select at 0x7f3ea90c5700>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:09.607869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-714e9efb-b6a1-4371-b5e5-81d26049d202 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] HTTP exception thrown: Volume tempest-invalid-428910222 could not be found. Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-714e9efb-b6a1-4371-b5e5-81d26049d202 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Request method failure captured: Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-428910222 HTTP/1.1 Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDBRziIQmO50w_7b0Tq7OeRxXX8CMH_xf7DcS8GDY0mVTulgF6EojwuMnROQkf9Gv65zW1EQRNuSly8xZrML6w764luMnFdiGVFbx5PRi367xIC9X2FlXVlc2wD29KWOIHGNFWtVaAmxNlFUCEf_heMiepWCLqaPCgiRqm5XU3DyLM Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:45:09.612513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_57c834b746fc4a11aa0226019923d4d0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 60c13dd599844219a310f5eb222ef41f Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Volume tempest-invalid-428910222 could not be found. Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'tempest-invalid-428910222'} Jun 22 11:45:09.614251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-428910222 could not be found. (HTTP 404) (Request-ID: req-1a9c459e-9f0f-4380-ac73-73fa14c96cb8) Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:09.615030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 11:45:09.616622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-428910222 could not be found. Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:45:09.617704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-428910222 could not be found. Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-428910222 could not be found. Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-714e9efb-b6a1-4371-b5e5-81d26049d202 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Returning 404 to user: Volume tempest-invalid-428910222 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:45:09.619370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-714e9efb-b6a1-4371-b5e5-81d26049d202 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-428910222" status: 404 len: 98 microversion: 2.1 time: 1.235043 Jun 22 11:45:09.625594 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 4/4] 10.222.0.36 () {58 vars in 1214 bytes} [Wed Jun 22 11:45:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-428910222 => generated 98 bytes in 1236 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 11:45:09.630860 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f8afcfa3-b4b4-4d12-86fd-21233b2e8a9b tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003991 Jun 22 11:45:09.631516 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 5/5] 10.222.0.36 () {58 vars in 1139 bytes} [Wed Jun 22 11:45:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 11:45:09.648464 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6654dd86-4b91-4659-8184-24b0d44ebf22 tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003760 Jun 22 11:45:09.649193 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 6/6] 10.222.0.36 () {58 vars in 1136 bytes} [Wed Jun 22 11:45:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 11:45:09.664487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-75169d53-d168-45c9-8d9b-28cc05df9c3b tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Calling method '.version_select at 0x7f3ea9077af0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:10.009853 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-75169d53-d168-45c9-8d9b-28cc05df9c3b tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] HTTP exception thrown: Volume 9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 could not be found. Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-75169d53-d168-45c9-8d9b-28cc05df9c3b tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Request method failure captured: Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: DELETE /compute/v2.1/os-volumes/9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 HTTP/1.1 Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDBRziIQmO50w_7b0Tq7OeRxXX8CMH_xf7DcS8GDY0mVTulgF6EojwuMnROQkf9Gv65zW1EQRNuSly8xZrML6w764luMnFdiGVFbx5PRi367xIC9X2FlXVlc2wD29KWOIHGNFWtVaAmxNlFUCEf_heMiepWCLqaPCgiRqm5XU3DyLM Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:45:10.019242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_57c834b746fc4a11aa0226019923d4d0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 60c13dd599844219a310f5eb222ef41f Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Volume 9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 could not be found. Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '9eeb27dc-acde-4a20-bf7e-bfc51a12ce65'} Jun 22 11:45:10.020797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 could not be found. (HTTP 404) (Request-ID: req-f39c9fc1-6e2f-4514-be50-5358febaeaf4) Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:10.021718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 11:45:10.023034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 could not be found. Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 11:45:10.024372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 could not be found. Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 could not be found. Jun 22 11:45:10.026473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.031573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-75169d53-d168-45c9-8d9b-28cc05df9c3b tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Returning 404 to user: Volume 9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:45:10.033120 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-75169d53-d168-45c9-8d9b-28cc05df9c3b tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/9eeb27dc-acde-4a20-bf7e-bfc51a12ce65" status: 404 len: 109 microversion: 2.1 time: 0.378244 Jun 22 11:45:10.034602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 7/7] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 11:45:09 2022] DELETE /compute/v2.1/os-volumes/9eeb27dc-acde-4a20-bf7e-bfc51a12ce65 => generated 109 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:45:10.048949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a7950fc2-d008-4540-81f3-fe72d5e5617a tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Calling method '.version_select at 0x7f3ea90774c0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:10.187274 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-a7950fc2-d008-4540-81f3-fe72d5e5617a tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] HTTP exception thrown: Volume 73c890f3-dfa1-4478-99be-b85fee1ea805 could not be found. Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a7950fc2-d008-4540-81f3-fe72d5e5617a tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Request method failure captured: Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/os-volumes/73c890f3-dfa1-4478-99be-b85fee1ea805 HTTP/1.1 Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDBRziIQmO50w_7b0Tq7OeRxXX8CMH_xf7DcS8GDY0mVTulgF6EojwuMnROQkf9Gv65zW1EQRNuSly8xZrML6w764luMnFdiGVFbx5PRi367xIC9X2FlXVlc2wD29KWOIHGNFWtVaAmxNlFUCEf_heMiepWCLqaPCgiRqm5XU3DyLM Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:45:10.191850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_57c834b746fc4a11aa0226019923d4d0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/57c834b746fc4a11aa0226019923d4d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 57c834b746fc4a11aa0226019923d4d0 Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesNegativeTest-1227614462 Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 60c13dd599844219a310f5eb222ef41f Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesNegativeTest-1227614462-project Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Volume 73c890f3-dfa1-4478-99be-b85fee1ea805 could not be found. Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '73c890f3-dfa1-4478-99be-b85fee1ea805'} Jun 22 11:45:10.193462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73c890f3-dfa1-4478-99be-b85fee1ea805 could not be found. (HTTP 404) (Request-ID: req-43c2de73-92a3-4d55-9db9-11541d575511) Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:10.194440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 11:45:10.204168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73c890f3-dfa1-4478-99be-b85fee1ea805 could not be found. Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 11:45:10.205665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73c890f3-dfa1-4478-99be-b85fee1ea805 could not be found. Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73c890f3-dfa1-4478-99be-b85fee1ea805 could not be found. Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a7950fc2-d008-4540-81f3-fe72d5e5617a tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] Returning 404 to user: Volume 73c890f3-dfa1-4478-99be-b85fee1ea805 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a7950fc2-d008-4540-81f3-fe72d5e5617a tempest-VolumesNegativeTest-1227614462 tempest-VolumesNegativeTest-1227614462-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/73c890f3-dfa1-4478-99be-b85fee1ea805" status: 404 len: 109 microversion: 2.1 time: 0.149791 Jun 22 11:45:10.207682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 8/8] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:45:10 2022] GET /compute/v2.1/os-volumes/73c890f3-dfa1-4478-99be-b85fee1ea805 => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 11:45:10.340121 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d0503896-91e3-4353-8298-315b6b37b84c tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.772140 Jun 22 11:45:10.340940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 1/9] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jun 22 11:45:05 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4777 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 11:45:10.353137 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2ee5ae49-e0a1-4260-8d76-56e3d5ae02fc tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Calling method '.version_select at 0x7f3ea9191ca0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:10.635203 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2ee5ae49-e0a1-4260-8d76-56e3d5ae02fc tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9" status: 200 len: 353 microversion: 2.1 time: 0.285687 Jun 22 11:45:10.636121 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 9/10] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:45:10 2022] GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9 => generated 353 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:11.649850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1e935434-fb0f-4911-90c5-6292800ad123 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Calling method '.version_select at 0x7f3ea90e85e0>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:11.785338 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1e935434-fb0f-4911-90c5-6292800ad123 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9" status: 200 len: 354 microversion: 2.1 time: 0.140054 Jun 22 11:45:11.786158 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 2/11] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:45:11 2022] GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9 => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:45:11.799274 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f1f89416-f2af-4119-9a5f-312a21e83715 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Calling method '.version_select at 0x7f3ea90c50d0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:11.917254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f1f89416-f2af-4119-9a5f-312a21e83715 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9" status: 200 len: 354 microversion: 2.1 time: 0.122606 Jun 22 11:45:11.919757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 10/12] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:45:11 2022] GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:11.941006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-94933e87-ba55-4e07-b58a-bd15fe043e7c tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Calling method '.version_select at 0x7f3ea90e8700>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:12.273147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-94933e87-ba55-4e07-b58a-bd15fe043e7c tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9" status: 202 len: 0 microversion: 2.1 time: 0.339146 Jun 22 11:45:12.273922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 3/13] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 11:45:11 2022] DELETE /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:45:12.281960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2581d5e0-f14c-4d3f-9509-521a8693d0ab tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Calling method '.version_select at 0x7f3ea90779d0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:12.439828 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2581d5e0-f14c-4d3f-9509-521a8693d0ab tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9" status: 200 len: 353 microversion: 2.1 time: 0.161561 Jun 22 11:45:12.440399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 11/14] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:45:12 2022] GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:45:13.457159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7d37d8ef-c95f-4400-aeca-c70a4c31e2a3 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Calling method '.version_select at 0x7f3ea90e8d30>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:13.691219 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-7d37d8ef-c95f-4400-aeca-c70a4c31e2a3 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] HTTP exception thrown: Volume 700207eb-b003-45f6-8954-7124ceee27a9 could not be found. Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7d37d8ef-c95f-4400-aeca-c70a4c31e2a3 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Request method failure captured: Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9 HTTP/1.1 Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswDBLSSe1zIu7o1VmhOrNdqVvTwYLz9bC0B6RjbCxBJMtP1FJ-PC5Vp2kt9VhMukIQlpywm2LHNun2chty8iAS_jqe3Q7G0zRdVwjUIN4oJOjXXlP04l45cVgeFkXNoP8ywqQq2CZPinFqHvZlR2Sw71Vyt_28-L5CytKBCo4jFOE3M Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 2889a1aa2fa64d6c8d83a9893cdd7b21 Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-VolumesGetTestJSON-1688497608 Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:45:13.704079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2889a1aa2fa64d6c8d83a9893cdd7b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2889a1aa2fa64d6c8d83a9893cdd7b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2889a1aa2fa64d6c8d83a9893cdd7b21", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2889a1aa2fa64d6c8d83a9893cdd7b21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-VolumesGetTestJSON-1688497608 Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 2889a1aa2fa64d6c8d83a9893cdd7b21 Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-VolumesGetTestJSON-1688497608 Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-VolumesGetTestJSON-1688497608-project Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 54b2ffa75d014f4691421782afb8664f Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-VolumesGetTestJSON-1688497608-project Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Volume 700207eb-b003-45f6-8954-7124ceee27a9 could not be found. Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '700207eb-b003-45f6-8954-7124ceee27a9'} Jun 22 11:45:13.705319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 700207eb-b003-45f6-8954-7124ceee27a9 could not be found. (HTTP 404) (Request-ID: req-9b236d6e-111a-4cf4-ac40-90c55ea20346) Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:13.706114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 11:45:13.707067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 700207eb-b003-45f6-8954-7124ceee27a9 could not be found. Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 11:45:13.710665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 700207eb-b003-45f6-8954-7124ceee27a9 could not be found. Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 700207eb-b003-45f6-8954-7124ceee27a9 could not be found. Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:45:13.712973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7d37d8ef-c95f-4400-aeca-c70a4c31e2a3 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] Returning 404 to user: Volume 700207eb-b003-45f6-8954-7124ceee27a9 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:45:13.714848 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7d37d8ef-c95f-4400-aeca-c70a4c31e2a3 tempest-VolumesGetTestJSON-1688497608 tempest-VolumesGetTestJSON-1688497608-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9" status: 404 len: 109 microversion: 2.1 time: 0.263565 Jun 22 11:45:13.714848 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 4/15] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:45:13 2022] GET /compute/v2.1/os-volumes/700207eb-b003-45f6-8954-7124ceee27a9 => generated 109 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:45:14.783513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1082142441", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "networks": [{"uuid": "e2435a9d-0db4-4607-940d-c099d4cd7af6"}]}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:15.029457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] validate_networks() for [('e2435a9d-0db4-4607-940d-c099d4cd7af6', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:45:17.928986 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:45:17.932548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:45:17.934649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:45:17.935075 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:45:17.935530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:45:17.987053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:18.006121 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:18.010771 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:18.012830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:18.120952 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Getting quotas for project 35df61dc9f3544a4ad9fa3be324d1e8b. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:45:18.141699 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Getting quotas for user 3b8a3e35ce254868bf3825cf60139979 and project 35df61dc9f3544a4ad9fa3be324d1e8b. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:45:18.182999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:45:18.192149 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:45:18.393748 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5bf2a4e1-3b74-43bd-9f9e-cca20248bfad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'create', calling method: .version_select at 0x7f3ea9080d30>, body: {"keypair": {"name": "tempest-keypair-1600561222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrgbi6YPZPLyqogUE7O9Gk09uT5J+7HoSomsW+C+3KYbkOfGEcMJVrCTROMcJ71t2cweJZIB45lIu6z9+bSP9o5wPveEENQmfv4V1awSZOXiZwItkb0rHaof7694sZiUQ=="}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:18.427232 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-17d022ce-4be5-4105-9718-00e96f204cd9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.974569 Jun 22 11:45:18.428277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 12/16] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:45:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:45:18.444599 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ddd080ad-d4c3-41c9-a35f-460e5b82ff80 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:18.445366 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ddd080ad-d4c3-41c9-a35f-460e5b82ff80 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:18.545537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-5bf2a4e1-3b74-43bd-9f9e-cca20248bfad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Getting quotas for project 878b71f291ec4107a09e3109b6acc40b. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:45:18.553324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-5bf2a4e1-3b74-43bd-9f9e-cca20248bfad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Getting quotas for user 4d7c1adbb2ad456eaf5793a15d6fcb4b and project 878b71f291ec4107a09e3109b6acc40b. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:45:18.664567 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5bf2a4e1-3b74-43bd-9f9e-cca20248bfad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.295508 Jun 22 11:45:18.667128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 5/17] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 11:45:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:18.790702 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ddd080ad-d4c3-41c9-a35f-460e5b82ff80 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:18.832523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ddd080ad-d4c3-41c9-a35f-460e5b82ff80 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1215 microversion: 2.1 time: 0.388221 Jun 22 11:45:18.833497 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 13/18] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:18 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1215 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:19.852164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a7637447-bb2a-4d58-8a27-79829e2be8b7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:19.852164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a7637447-bb2a-4d58-8a27-79829e2be8b7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:19.995890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a7637447-bb2a-4d58-8a27-79829e2be8b7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:20.012327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a7637447-bb2a-4d58-8a27-79829e2be8b7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1215 microversion: 2.1 time: 0.166962 Jun 22 11:45:20.014326 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 6/19] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:19 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:21.030997 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1a4ac4a8-1b65-4f6d-953a-711f9d83492c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:21.031703 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1a4ac4a8-1b65-4f6d-953a-711f9d83492c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:21.146017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1a4ac4a8-1b65-4f6d-953a-711f9d83492c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:21.153418 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1a4ac4a8-1b65-4f6d-953a-711f9d83492c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1215 microversion: 2.1 time: 0.126911 Jun 22 11:45:21.154011 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 7/20] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:21 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:21.216223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-112328591", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:21.357299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] validate_networks() for [('8379a407-3f34-4fda-9b10-2cf8a457f682', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:45:22.171948 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bea5fbbb-ca5c-4991-9546-945ed5592186 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:22.172583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bea5fbbb-ca5c-4991-9546-945ed5592186 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:22.185054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bea5fbbb-ca5c-4991-9546-945ed5592186 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:22.185499 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bea5fbbb-ca5c-4991-9546-945ed5592186 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:22.188249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bea5fbbb-ca5c-4991-9546-945ed5592186 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:22.189862 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bea5fbbb-ca5c-4991-9546-945ed5592186 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:22.196468 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:45:22.198184 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:45:22.199003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:45:22.199871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:45:22.200509 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:45:22.229848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:22.231183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:22.232653 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:22.233410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:22.259825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Getting quotas for project d20536d2fa444e97b7184c10e52d5cc5. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:45:22.264681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Getting quotas for user 27cc3d38926f470c91eeb6aecfc86a48 and project d20536d2fa444e97b7184c10e52d5cc5. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:45:22.285999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:45:22.288763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:45:22.393009 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-afd24192-5417-4628-b45a-5139d0a8bebc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.757251 Jun 22 11:45:22.401721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 14/21] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:45:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:45:22.417073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d56b52e7-4724-42fc-94fc-ba784f36261f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:22.417689 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d56b52e7-4724-42fc-94fc-ba784f36261f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:22.573070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d56b52e7-4724-42fc-94fc-ba784f36261f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:22.580495 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d56b52e7-4724-42fc-94fc-ba784f36261f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1221 microversion: 2.1 time: 0.177606 Jun 22 11:45:22.581066 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 15/22] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:22 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:22.655491 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bea5fbbb-ca5c-4991-9546-945ed5592186 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:22.683415 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1977819104", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d91d34e-dd0f-40af-839d-b9e28bcb41b2"}], "security_groups": [{"name": "tempest-securitygroup--897186387"}], "key_name": "tempest-keypair-1600561222", "user_data": "}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:22.703231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bea5fbbb-ca5c-4991-9546-945ed5592186 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1211 microversion: 2.1 time: 0.529677 Jun 22 11:45:22.711744 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 8/23] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:22 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1211 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:22.975687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] validate_networks() for [('2d91d34e-dd0f-40af-839d-b9e28bcb41b2', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:45:23.114747 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-430887779", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:23.382765 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] validate_networks() for [('8379a407-3f34-4fda-9b10-2cf8a457f682', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:45:24.508862 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:45:24.509796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:45:24.510497 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:45:24.511042 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:45:24.511621 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:45:24.536536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:24.536974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:24.544106 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:24.545553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:24.628603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Getting quotas for project 878b71f291ec4107a09e3109b6acc40b. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:45:24.652733 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Getting quotas for user 4d7c1adbb2ad456eaf5793a15d6fcb4b and project 878b71f291ec4107a09e3109b6acc40b. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:45:24.677241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:45:24.685451 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:45:24.814884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-30015951-e2ed-4d7d-8ae7-52614ff8ffa0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.137115 Jun 22 11:45:24.820052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 16/24] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:45:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:45:24.845761 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a382ccc5-5a20-4945-8251-b4d40da9bce7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:24.849418 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a382ccc5-5a20-4945-8251-b4d40da9bce7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:24.862159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a382ccc5-5a20-4945-8251-b4d40da9bce7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:24.862778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a382ccc5-5a20-4945-8251-b4d40da9bce7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:24.863759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a382ccc5-5a20-4945-8251-b4d40da9bce7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:24.864362 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a382ccc5-5a20-4945-8251-b4d40da9bce7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:25.204512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a382ccc5-5a20-4945-8251-b4d40da9bce7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:25.285686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a382ccc5-5a20-4945-8251-b4d40da9bce7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1273 microversion: 2.1 time: 0.463869 Jun 22 11:45:25.295734 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 17/25] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:24 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1273 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:25.318590 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fdafdea9-639a-4fcf-bf7d-08184a3241ee tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:25.320272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fdafdea9-639a-4fcf-bf7d-08184a3241ee tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:25.484539 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fdafdea9-639a-4fcf-bf7d-08184a3241ee tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:25.522764 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fdafdea9-639a-4fcf-bf7d-08184a3241ee tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1238 microversion: 2.1 time: 0.219741 Jun 22 11:45:25.542414 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 18/26] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:25 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1238 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:26.318604 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8f614f4c-ccaf-4361-857e-2bbbcbf490cc tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:26.319374 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8f614f4c-ccaf-4361-857e-2bbbcbf490cc tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:26.344309 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f614f4c-ccaf-4361-857e-2bbbcbf490cc tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:26.370301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f614f4c-ccaf-4361-857e-2bbbcbf490cc tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:26.374087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f614f4c-ccaf-4361-857e-2bbbcbf490cc tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:26.377111 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f614f4c-ccaf-4361-857e-2bbbcbf490cc tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:26.732319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:45:26.732800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:45:26.733255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:45:26.733661 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:45:26.734060 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:45:26.771558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:26.772448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:26.774420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:26.775081 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:26.862506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Getting quotas for project d20536d2fa444e97b7184c10e52d5cc5. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:45:26.874128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Getting quotas for user 27cc3d38926f470c91eeb6aecfc86a48 and project d20536d2fa444e97b7184c10e52d5cc5. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:45:26.909556 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:45:26.913924 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:45:27.043969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8f614f4c-ccaf-4361-857e-2bbbcbf490cc tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:27.060657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8f614f4c-ccaf-4361-857e-2bbbcbf490cc tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.746172 Jun 22 11:45:27.062729 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 19/27] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:26 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:27.080092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cca83993-8eee-4504-a357-415572caf6d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:27.081496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cca83993-8eee-4504-a357-415572caf6d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:27.093511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cca83993-8eee-4504-a357-415572caf6d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:27.095045 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cca83993-8eee-4504-a357-415572caf6d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:27.095807 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0b857e37-0316-412a-bfe3-595d41463ba9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.984329 Jun 22 11:45:27.096470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 9/28] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:45:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:45:27.101385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cca83993-8eee-4504-a357-415572caf6d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:27.101385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cca83993-8eee-4504-a357-415572caf6d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:27.122920 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7c8ef4ae-9b62-4693-8191-2615c9c50512 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:27.124404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7c8ef4ae-9b62-4693-8191-2615c9c50512 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:27.342258 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7c8ef4ae-9b62-4693-8191-2615c9c50512 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:27.355285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7c8ef4ae-9b62-4693-8191-2615c9c50512 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1221 microversion: 2.1 time: 0.248798 Jun 22 11:45:27.381045 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 10/29] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:27 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1221 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:27.472407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cca83993-8eee-4504-a357-415572caf6d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:27.495875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cca83993-8eee-4504-a357-415572caf6d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1242 microversion: 2.1 time: 0.421216 Jun 22 11:45:27.517953 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 20/30] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:27 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1242 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:28.084653 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9617e3ed-0244-4011-a97c-b661124b5846 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:28.086141 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9617e3ed-0244-4011-a97c-b661124b5846 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:28.099651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9617e3ed-0244-4011-a97c-b661124b5846 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:28.100595 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9617e3ed-0244-4011-a97c-b661124b5846 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:28.107457 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9617e3ed-0244-4011-a97c-b661124b5846 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:28.108496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9617e3ed-0244-4011-a97c-b661124b5846 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:28.350582 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9617e3ed-0244-4011-a97c-b661124b5846 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:28.358874 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9617e3ed-0244-4011-a97c-b661124b5846 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.281925 Jun 22 11:45:28.360662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 11/31] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:28 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:28.380602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f5275fd1-4415-43ff-b36a-87930d4220ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:28.382415 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f5275fd1-4415-43ff-b36a-87930d4220ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:28.399379 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f5275fd1-4415-43ff-b36a-87930d4220ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:28.401604 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f5275fd1-4415-43ff-b36a-87930d4220ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:28.403439 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f5275fd1-4415-43ff-b36a-87930d4220ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:28.405048 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f5275fd1-4415-43ff-b36a-87930d4220ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:28.492525 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f5275fd1-4415-43ff-b36a-87930d4220ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:28.501842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f5275fd1-4415-43ff-b36a-87930d4220ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1225 microversion: 2.1 time: 0.129336 Jun 22 11:45:28.511581 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 21/32] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:28 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:28.514046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-58f1d7ac-b169-4f60-9464-1bcbf9362f42 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:28.516255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-58f1d7ac-b169-4f60-9464-1bcbf9362f42 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:28.526028 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-58f1d7ac-b169-4f60-9464-1bcbf9362f42 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:28.527752 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-58f1d7ac-b169-4f60-9464-1bcbf9362f42 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:28.528741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-58f1d7ac-b169-4f60-9464-1bcbf9362f42 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:28.531317 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-58f1d7ac-b169-4f60-9464-1bcbf9362f42 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:28.670839 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-58f1d7ac-b169-4f60-9464-1bcbf9362f42 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:28.681642 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-58f1d7ac-b169-4f60-9464-1bcbf9362f42 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1242 microversion: 2.1 time: 0.171597 Jun 22 11:45:28.684898 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 12/33] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:28 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1242 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:29.393881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d5967974-49f8-4b8a-a011-e37a69fc3665 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:29.396309 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d5967974-49f8-4b8a-a011-e37a69fc3665 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:29.418187 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d5967974-49f8-4b8a-a011-e37a69fc3665 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:29.421327 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d5967974-49f8-4b8a-a011-e37a69fc3665 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:29.427906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d5967974-49f8-4b8a-a011-e37a69fc3665 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:29.431735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d5967974-49f8-4b8a-a011-e37a69fc3665 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:29.522849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-652e1fcd-0f63-4bf6-81fa-f066cfa047be tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:29.525156 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-652e1fcd-0f63-4bf6-81fa-f066cfa047be tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:29.541936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-652e1fcd-0f63-4bf6-81fa-f066cfa047be tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:29.543442 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-652e1fcd-0f63-4bf6-81fa-f066cfa047be tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:29.545490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-652e1fcd-0f63-4bf6-81fa-f066cfa047be tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:29.561869 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-652e1fcd-0f63-4bf6-81fa-f066cfa047be tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:29.968927 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-652e1fcd-0f63-4bf6-81fa-f066cfa047be tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:29.982194 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-652e1fcd-0f63-4bf6-81fa-f066cfa047be tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1225 microversion: 2.1 time: 0.466719 Jun 22 11:45:29.983546 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 13/34] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:29 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1225 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:29.994043 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-171312fc-6042-4f78-9e9b-bcb2bbea4768 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:29.995069 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-171312fc-6042-4f78-9e9b-bcb2bbea4768 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:30.006172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-171312fc-6042-4f78-9e9b-bcb2bbea4768 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:30.008871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-171312fc-6042-4f78-9e9b-bcb2bbea4768 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:30.011157 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-171312fc-6042-4f78-9e9b-bcb2bbea4768 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:30.012100 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-171312fc-6042-4f78-9e9b-bcb2bbea4768 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:30.312723 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d5967974-49f8-4b8a-a011-e37a69fc3665 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:30.318297 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-171312fc-6042-4f78-9e9b-bcb2bbea4768 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:30.339302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-171312fc-6042-4f78-9e9b-bcb2bbea4768 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1242 microversion: 2.1 time: 0.354377 Jun 22 11:45:30.348170 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 14/35] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:29 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1242 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:30.348496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d5967974-49f8-4b8a-a011-e37a69fc3665 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.969643 Jun 22 11:45:30.350155 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 22/36] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:29 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:31.003764 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0233bd4b-d859-4b15-aa5e-6649485ae081 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:31.004819 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0233bd4b-d859-4b15-aa5e-6649485ae081 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:31.029952 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0233bd4b-d859-4b15-aa5e-6649485ae081 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:31.032756 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0233bd4b-d859-4b15-aa5e-6649485ae081 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:31.034574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0233bd4b-d859-4b15-aa5e-6649485ae081 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:31.040577 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0233bd4b-d859-4b15-aa5e-6649485ae081 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:31.238350 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0233bd4b-d859-4b15-aa5e-6649485ae081 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:31.259825 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0233bd4b-d859-4b15-aa5e-6649485ae081 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1273 microversion: 2.1 time: 0.250805 Jun 22 11:45:31.260834 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 15/37] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:30 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:31.428035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d73d5265-bd6a-4427-9117-2d5cecb91970 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:31.428035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d73d5265-bd6a-4427-9117-2d5cecb91970 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:31.428197 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-421a75dd-aacc-46bf-beae-4080d3ff31cd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:31.428197 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-421a75dd-aacc-46bf-beae-4080d3ff31cd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:31.447276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-421a75dd-aacc-46bf-beae-4080d3ff31cd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:31.448286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d73d5265-bd6a-4427-9117-2d5cecb91970 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:31.448742 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d73d5265-bd6a-4427-9117-2d5cecb91970 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:31.449521 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d73d5265-bd6a-4427-9117-2d5cecb91970 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:31.449957 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d73d5265-bd6a-4427-9117-2d5cecb91970 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:31.453022 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-421a75dd-aacc-46bf-beae-4080d3ff31cd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:31.457102 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-421a75dd-aacc-46bf-beae-4080d3ff31cd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:31.458236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-421a75dd-aacc-46bf-beae-4080d3ff31cd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:31.817270 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-421a75dd-aacc-46bf-beae-4080d3ff31cd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:31.854728 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-421a75dd-aacc-46bf-beae-4080d3ff31cd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1290 microversion: 2.1 time: 0.496753 Jun 22 11:45:31.872264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 23/38] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:31 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1290 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:31.948149 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d73d5265-bd6a-4427-9117-2d5cecb91970 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:31.970725 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d73d5265-bd6a-4427-9117-2d5cecb91970 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.594408 Jun 22 11:45:31.972246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 16/39] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:31 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:32.279464 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-abcd9487-ba88-4a42-b902-65284bdd21cd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:32.280393 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-abcd9487-ba88-4a42-b902-65284bdd21cd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:32.294058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-abcd9487-ba88-4a42-b902-65284bdd21cd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:32.294818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-abcd9487-ba88-4a42-b902-65284bdd21cd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:32.296089 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-abcd9487-ba88-4a42-b902-65284bdd21cd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:32.296750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-abcd9487-ba88-4a42-b902-65284bdd21cd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:32.418425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-abcd9487-ba88-4a42-b902-65284bdd21cd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:32.427578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-abcd9487-ba88-4a42-b902-65284bdd21cd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1281 microversion: 2.1 time: 0.152331 Jun 22 11:45:32.430898 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 24/40] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:32 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:32.889287 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c5e0d151-4256-4cdb-8a61-537b18605571 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:32.889907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c5e0d151-4256-4cdb-8a61-537b18605571 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:32.909507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c5e0d151-4256-4cdb-8a61-537b18605571 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:32.909852 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c5e0d151-4256-4cdb-8a61-537b18605571 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:32.910652 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c5e0d151-4256-4cdb-8a61-537b18605571 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:32.918849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c5e0d151-4256-4cdb-8a61-537b18605571 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:32.990055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-81461c89-1084-463c-9a26-49112a89a853 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:32.991187 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-81461c89-1084-463c-9a26-49112a89a853 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:33.001602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-81461c89-1084-463c-9a26-49112a89a853 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:33.005418 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-81461c89-1084-463c-9a26-49112a89a853 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:33.006736 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-81461c89-1084-463c-9a26-49112a89a853 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:33.008548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-81461c89-1084-463c-9a26-49112a89a853 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:33.170675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c5e0d151-4256-4cdb-8a61-537b18605571 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:33.182873 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c5e0d151-4256-4cdb-8a61-537b18605571 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1290 microversion: 2.1 time: 0.295605 Jun 22 11:45:33.184488 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 17/41] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:32 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1290 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:33.362749 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-81461c89-1084-463c-9a26-49112a89a853 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:33.379231 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-81461c89-1084-463c-9a26-49112a89a853 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.393884 Jun 22 11:45:33.381060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 25/42] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:32 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:33.448890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-668ca46f-6d0a-4393-95f7-613ea77a8734 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:33.450259 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-668ca46f-6d0a-4393-95f7-613ea77a8734 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:33.486274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-668ca46f-6d0a-4393-95f7-613ea77a8734 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:33.487750 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-668ca46f-6d0a-4393-95f7-613ea77a8734 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:33.489160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-668ca46f-6d0a-4393-95f7-613ea77a8734 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:33.491835 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-668ca46f-6d0a-4393-95f7-613ea77a8734 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:33.641344 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-668ca46f-6d0a-4393-95f7-613ea77a8734 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:33.651419 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-668ca46f-6d0a-4393-95f7-613ea77a8734 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1279 microversion: 2.1 time: 0.206864 Jun 22 11:45:33.652150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 18/43] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:33 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:34.202683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-85a5927f-22da-477a-98b6-981e594ceceb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:34.208470 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-85a5927f-22da-477a-98b6-981e594ceceb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:34.221537 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-85a5927f-22da-477a-98b6-981e594ceceb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:34.221988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-85a5927f-22da-477a-98b6-981e594ceceb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:34.222902 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-85a5927f-22da-477a-98b6-981e594ceceb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:34.223183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-85a5927f-22da-477a-98b6-981e594ceceb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:34.398964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b878b18a-cdd1-4972-9f0c-bb89572043a2 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:34.399617 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b878b18a-cdd1-4972-9f0c-bb89572043a2 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:34.424211 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b878b18a-cdd1-4972-9f0c-bb89572043a2 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:34.424691 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b878b18a-cdd1-4972-9f0c-bb89572043a2 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:34.425591 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b878b18a-cdd1-4972-9f0c-bb89572043a2 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:34.426024 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b878b18a-cdd1-4972-9f0c-bb89572043a2 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:34.579834 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=6 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:35.234690 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-85a5927f-22da-477a-98b6-981e594ceceb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:35.258930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-85a5927f-22da-477a-98b6-981e594ceceb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1296 microversion: 2.1 time: 1.057574 Jun 22 11:45:35.264704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 26/44] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:34 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1296 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:35.277938 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ec7ec05c-f3d1-4a76-a764-66c1528ca76b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:35.279520 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ec7ec05c-f3d1-4a76-a764-66c1528ca76b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:35.291173 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec7ec05c-f3d1-4a76-a764-66c1528ca76b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:35.292042 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec7ec05c-f3d1-4a76-a764-66c1528ca76b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:35.293158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec7ec05c-f3d1-4a76-a764-66c1528ca76b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:35.293765 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec7ec05c-f3d1-4a76-a764-66c1528ca76b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:35.497820 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=24 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:35.618731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ec7ec05c-f3d1-4a76-a764-66c1528ca76b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:35.642420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ec7ec05c-f3d1-4a76-a764-66c1528ca76b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1279 microversion: 2.1 time: 0.375100 Jun 22 11:45:35.646758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 27/45] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:35 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1279 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:35.672261 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b878b18a-cdd1-4972-9f0c-bb89572043a2 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:35.694233 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b878b18a-cdd1-4972-9f0c-bb89572043a2 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 1.299727 Jun 22 11:45:35.696904 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 19/46] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:34 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:36.173183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-b3d3f50d-465f-47cd-90db-3689d2e32706 req-95a27a9c-e259-4b25-a14a-8c393bf46015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf84814-c021-401e-90d4-3b71f83a14a2", "tag": "f98ebffe-f0f3-42f3-b0e7-858c2b11ea46"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:36.203049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:36.211246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-b3d3f50d-465f-47cd-90db-3689d2e32706 req-95a27a9c-e259-4b25-a14a-8c393bf46015 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.212041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-b3d3f50d-465f-47cd-90db-3689d2e32706 req-95a27a9c-e259-4b25-a14a-8c393bf46015 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.271105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-b3d3f50d-465f-47cd-90db-3689d2e32706 req-95a27a9c-e259-4b25-a14a-8c393bf46015 service nova] Creating event network-changed:f98ebffe-f0f3-42f3-b0e7-858c2b11ea46 for instance 0bf84814-c021-401e-90d4-3b71f83a14a2 on hv-cinder-83697 Jun 22 11:45:36.272694 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-b3d3f50d-465f-47cd-90db-3689d2e32706 req-95a27a9c-e259-4b25-a14a-8c393bf46015 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129528) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 11:45:36.276260 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3cc8618c-e72f-4a88-8c64-f7896b597005 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.276976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3cc8618c-e72f-4a88-8c64-f7896b597005 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.278295 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3cc8618c-e72f-4a88-8c64-f7896b597005 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.279031 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3cc8618c-e72f-4a88-8c64-f7896b597005 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.293360 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.compute.rpcapi [None req-3cc8618c-e72f-4a88-8c64-f7896b597005 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 11:45:36.293906 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-36e488f0-747a-4f6b-b4b5-249303b61d41 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:36.294920 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-36e488f0-747a-4f6b-b4b5-249303b61d41 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:36.295503 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3cc8618c-e72f-4a88-8c64-f7896b597005 None None] Releasing lock "compute-rpcapi-router" {{(pid=129528) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 11:45:36.313521 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36e488f0-747a-4f6b-b4b5-249303b61d41 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.314114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36e488f0-747a-4f6b-b4b5-249303b61d41 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.315116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36e488f0-747a-4f6b-b4b5-249303b61d41 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.315989 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36e488f0-747a-4f6b-b4b5-249303b61d41 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.342183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3cc8618c-e72f-4a88-8c64-f7896b597005 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.693195 Jun 22 11:45:36.343861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 28/47] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:36.453434 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-36e488f0-747a-4f6b-b4b5-249303b61d41 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:36.485182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-36e488f0-747a-4f6b-b4b5-249303b61d41 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1296 microversion: 2.1 time: 0.201298 Jun 22 11:45:36.487972 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 20/48] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:36 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1296 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:36.663817 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-352eae55-b300-4502-a8e0-a69174f6f3db tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:36.664627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-352eae55-b300-4502-a8e0-a69174f6f3db tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:36.694504 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-352eae55-b300-4502-a8e0-a69174f6f3db tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.695129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-352eae55-b300-4502-a8e0-a69174f6f3db tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.696361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-352eae55-b300-4502-a8e0-a69174f6f3db tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.704304 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-352eae55-b300-4502-a8e0-a69174f6f3db tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.712368 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-01be36e3-cfe3-4bd8-8e22-ee1ab025bc9f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:36.712986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-01be36e3-cfe3-4bd8-8e22-ee1ab025bc9f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:36.730851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-01be36e3-cfe3-4bd8-8e22-ee1ab025bc9f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.731312 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-01be36e3-cfe3-4bd8-8e22-ee1ab025bc9f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.732168 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-01be36e3-cfe3-4bd8-8e22-ee1ab025bc9f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:36.735232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-01be36e3-cfe3-4bd8-8e22-ee1ab025bc9f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:36.820177 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:36.876627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-352eae55-b300-4502-a8e0-a69174f6f3db tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:36.888897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-352eae55-b300-4502-a8e0-a69174f6f3db tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1279 microversion: 2.1 time: 0.230515 Jun 22 11:45:36.894188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 29/49] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:36 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:37.061744 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-01be36e3-cfe3-4bd8-8e22-ee1ab025bc9f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:37.073943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-01be36e3-cfe3-4bd8-8e22-ee1ab025bc9f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.365874 Jun 22 11:45:37.086978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 21/50] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:36 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:37.507721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4841539b-78e3-4330-a09d-6983055251a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:37.509217 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4841539b-78e3-4330-a09d-6983055251a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:37.545838 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4841539b-78e3-4330-a09d-6983055251a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:37.547923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4841539b-78e3-4330-a09d-6983055251a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:37.562801 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4841539b-78e3-4330-a09d-6983055251a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:37.571301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4841539b-78e3-4330-a09d-6983055251a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:37.912310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-76bb5591-8970-47e4-8c37-dd3fa99db11b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:37.913059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-76bb5591-8970-47e4-8c37-dd3fa99db11b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:37.918712 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=16 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:37.939645 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76bb5591-8970-47e4-8c37-dd3fa99db11b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:37.941031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76bb5591-8970-47e4-8c37-dd3fa99db11b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:37.950727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76bb5591-8970-47e4-8c37-dd3fa99db11b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:37.954780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76bb5591-8970-47e4-8c37-dd3fa99db11b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:39.927905 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4841539b-78e3-4330-a09d-6983055251a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:39.942865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4841539b-78e3-4330-a09d-6983055251a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 2.442059 Jun 22 11:45:39.966792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 30/51] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:37 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:39.985201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-789b7c90-562a-4079-907b-0df50085d6b0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:39.985821 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-789b7c90-562a-4079-907b-0df50085d6b0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:40.008687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-789b7c90-562a-4079-907b-0df50085d6b0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:40.012400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-76bb5591-8970-47e4-8c37-dd3fa99db11b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:40.019826 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-789b7c90-562a-4079-907b-0df50085d6b0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:40.024880 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-789b7c90-562a-4079-907b-0df50085d6b0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:40.040722 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-789b7c90-562a-4079-907b-0df50085d6b0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:40.041324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-76bb5591-8970-47e4-8c37-dd3fa99db11b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 2.122143 Jun 22 11:45:40.046185 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 22/52] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:37 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:40.971815 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c02fe2fb-2d16-44a1-ace6-c4ce4e7bf343 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:40.973063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c02fe2fb-2d16-44a1-ace6-c4ce4e7bf343 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:40.981392 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-789b7c90-562a-4079-907b-0df50085d6b0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:40.996583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c02fe2fb-2d16-44a1-ace6-c4ce4e7bf343 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:40.997288 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c02fe2fb-2d16-44a1-ace6-c4ce4e7bf343 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:40.998327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c02fe2fb-2d16-44a1-ace6-c4ce4e7bf343 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:40.998936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c02fe2fb-2d16-44a1-ace6-c4ce4e7bf343 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:41.004823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-789b7c90-562a-4079-907b-0df50085d6b0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 1.032776 Jun 22 11:45:41.007906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 31/53] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:39 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:41.058678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-943b0c33-5bd9-4554-ab56-486f9b1b2e55 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:41.059290 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-943b0c33-5bd9-4554-ab56-486f9b1b2e55 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:41.074966 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-943b0c33-5bd9-4554-ab56-486f9b1b2e55 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:41.075431 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-943b0c33-5bd9-4554-ab56-486f9b1b2e55 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:41.076208 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-943b0c33-5bd9-4554-ab56-486f9b1b2e55 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:41.076638 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-943b0c33-5bd9-4554-ab56-486f9b1b2e55 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:41.358681 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c02fe2fb-2d16-44a1-ace6-c4ce4e7bf343 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:41.372526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c02fe2fb-2d16-44a1-ace6-c4ce4e7bf343 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.406069 Jun 22 11:45:41.373749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 23/54] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:40 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:41.407669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-943b0c33-5bd9-4554-ab56-486f9b1b2e55 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:41.418272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-943b0c33-5bd9-4554-ab56-486f9b1b2e55 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.363295 Jun 22 11:45:41.443701 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 32/55] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:41 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:41.465426 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-95bb13fd-7905-4313-bde2-2725947b0de9 req-2b549332-12f7-4b30-9840-02b9b168cbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3c3cce-4dbe-44a3-b2df-7e43078812f8", "tag": "2a25c2c3-035b-4263-bc42-63433b20fb62"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:41.487637 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-95bb13fd-7905-4313-bde2-2725947b0de9 req-2b549332-12f7-4b30-9840-02b9b168cbb4 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:41.489610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-95bb13fd-7905-4313-bde2-2725947b0de9 req-2b549332-12f7-4b30-9840-02b9b168cbb4 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:41.527272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-95bb13fd-7905-4313-bde2-2725947b0de9 req-2b549332-12f7-4b30-9840-02b9b168cbb4 service nova] Creating event network-changed:2a25c2c3-035b-4263-bc42-63433b20fb62 for instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 on hv-cinder-83697 Jun 22 11:45:41.538060 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-50f5d427-f5d8-49bf-9102-e8dba8589415 req-eaa85d98-b966-491c-a37c-6ee5d3ca7f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6ebc0a-848b-4688-939a-062ccc6dc352", "tag": "f2a96738-75af-44d5-9821-e335309678f0"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:41.553468 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-95bb13fd-7905-4313-bde2-2725947b0de9 req-2b549332-12f7-4b30-9840-02b9b168cbb4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090676 Jun 22 11:45:41.556138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-50f5d427-f5d8-49bf-9102-e8dba8589415 req-eaa85d98-b966-491c-a37c-6ee5d3ca7f7f service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:41.556280 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 33/56] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:41.557018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-50f5d427-f5d8-49bf-9102-e8dba8589415 req-eaa85d98-b966-491c-a37c-6ee5d3ca7f7f service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:41.602489 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-50f5d427-f5d8-49bf-9102-e8dba8589415 req-eaa85d98-b966-491c-a37c-6ee5d3ca7f7f service nova] Creating event network-changed:f2a96738-75af-44d5-9821-e335309678f0 for instance af6ebc0a-848b-4688-939a-062ccc6dc352 on hv-cinder-83697 Jun 22 11:45:41.603257 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-50f5d427-f5d8-49bf-9102-e8dba8589415 req-eaa85d98-b966-491c-a37c-6ee5d3ca7f7f service nova] Acquired lock "compute-rpcapi-router" {{(pid=129527) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 11:45:41.607253 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2e19e39-3ca0-4203-bf4c-6b5e8eb3e1f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:41.609175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2e19e39-3ca0-4203-bf4c-6b5e8eb3e1f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:41.611648 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2e19e39-3ca0-4203-bf4c-6b5e8eb3e1f4 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:41.612568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2e19e39-3ca0-4203-bf4c-6b5e8eb3e1f4 None None] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:41.674451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.compute.rpcapi [None req-e2e19e39-3ca0-4203-bf4c-6b5e8eb3e1f4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 11:45:41.675810 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2e19e39-3ca0-4203-bf4c-6b5e8eb3e1f4 None None] Releasing lock "compute-rpcapi-router" {{(pid=129527) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 11:45:41.710827 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e2e19e39-3ca0-4203-bf4c-6b5e8eb3e1f4 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335420 Jun 22 11:45:41.711478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 24/57] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:42.023799 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-26c9f3ab-4d83-4b8b-b2d2-85d4417312ab tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:42.025055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-26c9f3ab-4d83-4b8b-b2d2-85d4417312ab tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:42.036435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-26c9f3ab-4d83-4b8b-b2d2-85d4417312ab tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:42.036889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-26c9f3ab-4d83-4b8b-b2d2-85d4417312ab tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:42.040060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-26c9f3ab-4d83-4b8b-b2d2-85d4417312ab tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:42.041872 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-26c9f3ab-4d83-4b8b-b2d2-85d4417312ab tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:42.089974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:42.269762 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-26c9f3ab-4d83-4b8b-b2d2-85d4417312ab tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:42.278406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-26c9f3ab-4d83-4b8b-b2d2-85d4417312ab tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.259056 Jun 22 11:45:42.280562 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 34/58] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:42 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:42.393216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8033e159-4c8c-410c-918c-7d7e1cf8c445 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:42.394454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8033e159-4c8c-410c-918c-7d7e1cf8c445 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:42.419565 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8033e159-4c8c-410c-918c-7d7e1cf8c445 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:42.423311 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8033e159-4c8c-410c-918c-7d7e1cf8c445 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:42.426123 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8033e159-4c8c-410c-918c-7d7e1cf8c445 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:42.426868 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8033e159-4c8c-410c-918c-7d7e1cf8c445 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:42.439085 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-48c4325e-06e2-4029-96b1-7c2233b736c2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:42.440031 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-48c4325e-06e2-4029-96b1-7c2233b736c2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:42.461717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-48c4325e-06e2-4029-96b1-7c2233b736c2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:42.464296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-48c4325e-06e2-4029-96b1-7c2233b736c2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:42.465569 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-48c4325e-06e2-4029-96b1-7c2233b736c2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:42.472363 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-48c4325e-06e2-4029-96b1-7c2233b736c2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:42.791518 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8033e159-4c8c-410c-918c-7d7e1cf8c445 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:42.799596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8033e159-4c8c-410c-918c-7d7e1cf8c445 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.413052 Jun 22 11:45:42.805075 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 25/59] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:42 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:42.890366 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-48c4325e-06e2-4029-96b1-7c2233b736c2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:42.898760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-48c4325e-06e2-4029-96b1-7c2233b736c2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.464012 Jun 22 11:45:42.905460 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 35/60] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:42 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:43.298532 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4b017534-b321-4271-8850-37ed296aec55 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:43.300019 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4b017534-b321-4271-8850-37ed296aec55 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:43.308132 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4b017534-b321-4271-8850-37ed296aec55 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:43.309071 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4b017534-b321-4271-8850-37ed296aec55 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:43.310270 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4b017534-b321-4271-8850-37ed296aec55 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:43.310985 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4b017534-b321-4271-8850-37ed296aec55 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:43.338069 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:43.486343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4b017534-b321-4271-8850-37ed296aec55 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:43.495538 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4b017534-b321-4271-8850-37ed296aec55 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.202170 Jun 22 11:45:43.498148 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 26/61] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:43 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:43.621787 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-4cc48a9a-2e31-40ec-bb23-3021f8258d31 req-2e98d622-8f98-49ba-bbb8-6ffc257fb5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1581a659-3e36-43de-ac70-26d15c41f86e", "tag": "cf6ccaa0-4359-4273-b639-c746e0759b41"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:43.631775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-4cc48a9a-2e31-40ec-bb23-3021f8258d31 req-2e98d622-8f98-49ba-bbb8-6ffc257fb5c2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:43.632416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-4cc48a9a-2e31-40ec-bb23-3021f8258d31 req-2e98d622-8f98-49ba-bbb8-6ffc257fb5c2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:43.654087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-4cc48a9a-2e31-40ec-bb23-3021f8258d31 req-2e98d622-8f98-49ba-bbb8-6ffc257fb5c2 service nova] Creating event network-changed:cf6ccaa0-4359-4273-b639-c746e0759b41 for instance 1581a659-3e36-43de-ac70-26d15c41f86e on hv-cinder-83697 Jun 22 11:45:43.661455 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-4cc48a9a-2e31-40ec-bb23-3021f8258d31 req-2e98d622-8f98-49ba-bbb8-6ffc257fb5c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043171 Jun 22 11:45:43.665759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 36/62] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:43.822678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7e430f89-cdd5-4790-94f6-b83b9e18010c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:43.823291 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7e430f89-cdd5-4790-94f6-b83b9e18010c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:43.830259 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e430f89-cdd5-4790-94f6-b83b9e18010c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:43.830784 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e430f89-cdd5-4790-94f6-b83b9e18010c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:43.831934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e430f89-cdd5-4790-94f6-b83b9e18010c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:43.832377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e430f89-cdd5-4790-94f6-b83b9e18010c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:43.923250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4794378a-59ac-458b-86ce-01e3d6828796 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:43.924388 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4794378a-59ac-458b-86ce-01e3d6828796 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:43.931697 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4794378a-59ac-458b-86ce-01e3d6828796 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:43.932318 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4794378a-59ac-458b-86ce-01e3d6828796 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:43.933418 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4794378a-59ac-458b-86ce-01e3d6828796 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:43.934162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4794378a-59ac-458b-86ce-01e3d6828796 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:43.999741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7e430f89-cdd5-4790-94f6-b83b9e18010c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:44.010975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7e430f89-cdd5-4790-94f6-b83b9e18010c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.192261 Jun 22 11:45:44.023124 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 27/63] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:43 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:44.119181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4794378a-59ac-458b-86ce-01e3d6828796 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:44.127296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4794378a-59ac-458b-86ce-01e3d6828796 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.209141 Jun 22 11:45:44.127891 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 37/64] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:43 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:44.514096 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2c66b6d2-c183-4f4d-b508-e95212258673 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:44.514721 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2c66b6d2-c183-4f4d-b508-e95212258673 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:44.523150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2c66b6d2-c183-4f4d-b508-e95212258673 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:44.523633 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2c66b6d2-c183-4f4d-b508-e95212258673 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:44.524453 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2c66b6d2-c183-4f4d-b508-e95212258673 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:44.524916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2c66b6d2-c183-4f4d-b508-e95212258673 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:44.694417 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2c66b6d2-c183-4f4d-b508-e95212258673 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:44.702783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2c66b6d2-c183-4f4d-b508-e95212258673 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.193071 Jun 22 11:45:44.705278 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 28/65] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:44 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:45.029167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-112e91bd-103c-4c0e-8633-e2201806664a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:45.030378 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-112e91bd-103c-4c0e-8633-e2201806664a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:45.036855 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-112e91bd-103c-4c0e-8633-e2201806664a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:45.037560 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-112e91bd-103c-4c0e-8633-e2201806664a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:45.038427 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-112e91bd-103c-4c0e-8633-e2201806664a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:45.038931 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-112e91bd-103c-4c0e-8633-e2201806664a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:45.145496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e981c48e-085e-4981-bcfc-58240edd19a8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:45.147329 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e981c48e-085e-4981-bcfc-58240edd19a8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:45.154104 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e981c48e-085e-4981-bcfc-58240edd19a8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:45.154890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e981c48e-085e-4981-bcfc-58240edd19a8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:45.157362 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e981c48e-085e-4981-bcfc-58240edd19a8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:45.158038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e981c48e-085e-4981-bcfc-58240edd19a8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:45.309910 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-112e91bd-103c-4c0e-8633-e2201806664a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:45.327051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-112e91bd-103c-4c0e-8633-e2201806664a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.299520 Jun 22 11:45:45.328002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 38/66] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:45 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:45.482848 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e981c48e-085e-4981-bcfc-58240edd19a8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:45.494156 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e981c48e-085e-4981-bcfc-58240edd19a8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.353188 Jun 22 11:45:45.495779 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 29/67] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:45 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:45.723592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-86a15e12-9323-4ed6-928c-fe0dd9cbf0c4 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:45.724207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-86a15e12-9323-4ed6-928c-fe0dd9cbf0c4 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:45.738850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-86a15e12-9323-4ed6-928c-fe0dd9cbf0c4 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:45.739601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-86a15e12-9323-4ed6-928c-fe0dd9cbf0c4 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:45.740503 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-86a15e12-9323-4ed6-928c-fe0dd9cbf0c4 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:45.740823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-86a15e12-9323-4ed6-928c-fe0dd9cbf0c4 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:46.290243 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:46.318534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-86a15e12-9323-4ed6-928c-fe0dd9cbf0c4 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:46.330321 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-86a15e12-9323-4ed6-928c-fe0dd9cbf0c4 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.611153 Jun 22 11:45:46.332545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 39/68] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:45 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:46.346465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-404bd9a7-f9c9-45dc-a6b3-6cb82aeb4797 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:46.347639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-404bd9a7-f9c9-45dc-a6b3-6cb82aeb4797 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:46.355110 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-404bd9a7-f9c9-45dc-a6b3-6cb82aeb4797 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:46.355825 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-404bd9a7-f9c9-45dc-a6b3-6cb82aeb4797 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:46.356758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-404bd9a7-f9c9-45dc-a6b3-6cb82aeb4797 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:46.357339 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-404bd9a7-f9c9-45dc-a6b3-6cb82aeb4797 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:46.512560 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ba821af1-ac7d-4230-9556-330857384e73 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:46.513191 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ba821af1-ac7d-4230-9556-330857384e73 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:46.538272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba821af1-ac7d-4230-9556-330857384e73 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:46.539055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba821af1-ac7d-4230-9556-330857384e73 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:46.540757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba821af1-ac7d-4230-9556-330857384e73 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:46.541342 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba821af1-ac7d-4230-9556-330857384e73 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:46.751656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-404bd9a7-f9c9-45dc-a6b3-6cb82aeb4797 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:46.779658 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-404bd9a7-f9c9-45dc-a6b3-6cb82aeb4797 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.437362 Jun 22 11:45:46.780292 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 30/69] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:46 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:46.809624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ba821af1-ac7d-4230-9556-330857384e73 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:46.820153 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ba821af1-ac7d-4230-9556-330857384e73 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.311795 Jun 22 11:45:46.821292 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 40/70] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:46 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:47.350123 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-98fa08c0-9d74-4212-93ff-cb9599110a33 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:47.350970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-98fa08c0-9d74-4212-93ff-cb9599110a33 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:47.358238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-98fa08c0-9d74-4212-93ff-cb9599110a33 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:47.358692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-98fa08c0-9d74-4212-93ff-cb9599110a33 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:47.359548 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-98fa08c0-9d74-4212-93ff-cb9599110a33 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:47.362844 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-98fa08c0-9d74-4212-93ff-cb9599110a33 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:47.585819 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-98fa08c0-9d74-4212-93ff-cb9599110a33 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:47.625393 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-98fa08c0-9d74-4212-93ff-cb9599110a33 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.279869 Jun 22 11:45:47.635444 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 31/71] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:47 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:47.802645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ee3630b2-d4f8-40dd-926a-7f8c40755736 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:47.803252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ee3630b2-d4f8-40dd-926a-7f8c40755736 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:47.820048 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ee3630b2-d4f8-40dd-926a-7f8c40755736 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:47.820513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ee3630b2-d4f8-40dd-926a-7f8c40755736 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:47.822657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ee3630b2-d4f8-40dd-926a-7f8c40755736 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:47.822996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ee3630b2-d4f8-40dd-926a-7f8c40755736 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:47.845355 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e9ad8dd8-2f8f-407c-a8d7-10af38c66b5a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:47.846154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e9ad8dd8-2f8f-407c-a8d7-10af38c66b5a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:47.848242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:47.856969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e9ad8dd8-2f8f-407c-a8d7-10af38c66b5a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:47.857422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e9ad8dd8-2f8f-407c-a8d7-10af38c66b5a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:47.858195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e9ad8dd8-2f8f-407c-a8d7-10af38c66b5a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:47.860725 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e9ad8dd8-2f8f-407c-a8d7-10af38c66b5a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:48.150100 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ee3630b2-d4f8-40dd-926a-7f8c40755736 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:48.161283 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e9ad8dd8-2f8f-407c-a8d7-10af38c66b5a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:48.176842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ee3630b2-d4f8-40dd-926a-7f8c40755736 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.377919 Jun 22 11:45:48.178509 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 41/72] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:47 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:48.181232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e9ad8dd8-2f8f-407c-a8d7-10af38c66b5a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.347564 Jun 22 11:45:48.182206 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 32/73] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:47 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:48.646662 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d2c68f7c-4ecc-4280-9065-19e8a4594e1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:48.647379 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d2c68f7c-4ecc-4280-9065-19e8a4594e1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:48.655547 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d2c68f7c-4ecc-4280-9065-19e8a4594e1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:48.656387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d2c68f7c-4ecc-4280-9065-19e8a4594e1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:48.657305 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d2c68f7c-4ecc-4280-9065-19e8a4594e1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:48.657835 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d2c68f7c-4ecc-4280-9065-19e8a4594e1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:48.833305 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d2c68f7c-4ecc-4280-9065-19e8a4594e1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:48.841121 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d2c68f7c-4ecc-4280-9065-19e8a4594e1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.201571 Jun 22 11:45:48.842232 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 42/74] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:48 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:49.196044 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bff3b37f-787f-4474-a633-339daf18b36a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:49.196673 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bff3b37f-787f-4474-a633-339daf18b36a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:49.207859 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1aa4675f-df55-455e-b76a-82335fbbc35e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:49.209089 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1aa4675f-df55-455e-b76a-82335fbbc35e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:49.225334 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1aa4675f-df55-455e-b76a-82335fbbc35e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:49.227343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bff3b37f-787f-4474-a633-339daf18b36a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:49.227813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bff3b37f-787f-4474-a633-339daf18b36a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:49.228583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bff3b37f-787f-4474-a633-339daf18b36a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:49.229024 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bff3b37f-787f-4474-a633-339daf18b36a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:49.232137 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1aa4675f-df55-455e-b76a-82335fbbc35e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:49.233995 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1aa4675f-df55-455e-b76a-82335fbbc35e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:49.235835 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1aa4675f-df55-455e-b76a-82335fbbc35e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:49.653782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1aa4675f-df55-455e-b76a-82335fbbc35e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:49.665176 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1aa4675f-df55-455e-b76a-82335fbbc35e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.462864 Jun 22 11:45:49.667114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bff3b37f-787f-4474-a633-339daf18b36a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:49.674347 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 43/75] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:49 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:49.676331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bff3b37f-787f-4474-a633-339daf18b36a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.484590 Jun 22 11:45:49.678072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 33/76] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:49 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:49.823528 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-42dd5560-e9c4-47b2-b6ad-0745b3389e0a req-3da1eb6d-1034-4a9c-8bf4-4b2449f11550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf84814-c021-401e-90d4-3b71f83a14a2", "name": "network-vif-plugged", "status": "completed", "tag": "f98ebffe-f0f3-42f3-b0e7-858c2b11ea46"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:49.835414 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-42dd5560-e9c4-47b2-b6ad-0745b3389e0a req-3da1eb6d-1034-4a9c-8bf4-4b2449f11550 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:49.836117 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-42dd5560-e9c4-47b2-b6ad-0745b3389e0a req-3da1eb6d-1034-4a9c-8bf4-4b2449f11550 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:49.860010 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-29e1b9fe-918f-42b2-8bb4-4a1c5ca8408c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:49.861024 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-29e1b9fe-918f-42b2-8bb4-4a1c5ca8408c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:49.867745 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-42dd5560-e9c4-47b2-b6ad-0745b3389e0a req-3da1eb6d-1034-4a9c-8bf4-4b2449f11550 service nova] Creating event network-vif-plugged:f98ebffe-f0f3-42f3-b0e7-858c2b11ea46 for instance 0bf84814-c021-401e-90d4-3b71f83a14a2 on hv-cinder-83697 Jun 22 11:45:49.872347 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-29e1b9fe-918f-42b2-8bb4-4a1c5ca8408c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:49.873018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-29e1b9fe-918f-42b2-8bb4-4a1c5ca8408c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:49.873952 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-29e1b9fe-918f-42b2-8bb4-4a1c5ca8408c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:49.878460 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-29e1b9fe-918f-42b2-8bb4-4a1c5ca8408c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:49.880378 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-42dd5560-e9c4-47b2-b6ad-0745b3389e0a req-3da1eb6d-1034-4a9c-8bf4-4b2449f11550 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203340 Jun 22 11:45:49.883286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 44/77] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:50.153890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-29e1b9fe-918f-42b2-8bb4-4a1c5ca8408c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:50.162651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-29e1b9fe-918f-42b2-8bb4-4a1c5ca8408c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.306940 Jun 22 11:45:50.163707 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 34/78] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:49 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:50.698301 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-846ffaff-3ab5-43c4-96c7-ca6b48fb4362 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:50.699025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-846ffaff-3ab5-43c4-96c7-ca6b48fb4362 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:50.700889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-72f10b9b-9472-483d-8648-94b89c8a2ddf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:50.702694 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-72f10b9b-9472-483d-8648-94b89c8a2ddf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:50.712223 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-846ffaff-3ab5-43c4-96c7-ca6b48fb4362 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:50.712477 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-72f10b9b-9472-483d-8648-94b89c8a2ddf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:50.713020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-846ffaff-3ab5-43c4-96c7-ca6b48fb4362 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:50.713431 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-72f10b9b-9472-483d-8648-94b89c8a2ddf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:50.714082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-846ffaff-3ab5-43c4-96c7-ca6b48fb4362 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:50.714576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-846ffaff-3ab5-43c4-96c7-ca6b48fb4362 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:50.714812 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-72f10b9b-9472-483d-8648-94b89c8a2ddf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:50.715471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-72f10b9b-9472-483d-8648-94b89c8a2ddf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:50.979251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-72f10b9b-9472-483d-8648-94b89c8a2ddf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:50.984891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-846ffaff-3ab5-43c4-96c7-ca6b48fb4362 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:50.989288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-72f10b9b-9472-483d-8648-94b89c8a2ddf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.304239 Jun 22 11:45:50.989942 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 45/79] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:50 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:51.002674 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-846ffaff-3ab5-43c4-96c7-ca6b48fb4362 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.311200 Jun 22 11:45:51.003402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 35/80] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:50 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:51.192214 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4e488109-07fe-4b77-9fc0-5b863cc8b6dd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:51.193623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4e488109-07fe-4b77-9fc0-5b863cc8b6dd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:51.209445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4e488109-07fe-4b77-9fc0-5b863cc8b6dd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:51.210475 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4e488109-07fe-4b77-9fc0-5b863cc8b6dd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:51.212322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4e488109-07fe-4b77-9fc0-5b863cc8b6dd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:51.213220 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4e488109-07fe-4b77-9fc0-5b863cc8b6dd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:51.491627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4e488109-07fe-4b77-9fc0-5b863cc8b6dd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:51.506659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4e488109-07fe-4b77-9fc0-5b863cc8b6dd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.328341 Jun 22 11:45:51.524128 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 46/81] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:51 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:52.008626 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-25404d54-7e14-494a-a16c-7cbe6c833c03 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:52.010623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-25404d54-7e14-494a-a16c-7cbe6c833c03 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:52.012656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:52.019033 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25404d54-7e14-494a-a16c-7cbe6c833c03 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:52.020160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25404d54-7e14-494a-a16c-7cbe6c833c03 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:52.021325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25404d54-7e14-494a-a16c-7cbe6c833c03 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:52.021978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25404d54-7e14-494a-a16c-7cbe6c833c03 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:52.022515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9d00aefd-8361-4fb1-ae3e-fcf9fc31b789 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:52.023560 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9d00aefd-8361-4fb1-ae3e-fcf9fc31b789 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:52.032528 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9d00aefd-8361-4fb1-ae3e-fcf9fc31b789 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:52.032975 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9d00aefd-8361-4fb1-ae3e-fcf9fc31b789 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:52.033772 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9d00aefd-8361-4fb1-ae3e-fcf9fc31b789 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:52.034703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9d00aefd-8361-4fb1-ae3e-fcf9fc31b789 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:52.246860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-25404d54-7e14-494a-a16c-7cbe6c833c03 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:52.255329 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-25404d54-7e14-494a-a16c-7cbe6c833c03 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.250708 Jun 22 11:45:52.265506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 36/82] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:52 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:52.265611 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9d00aefd-8361-4fb1-ae3e-fcf9fc31b789 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:52.270514 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9d00aefd-8361-4fb1-ae3e-fcf9fc31b789 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.253594 Jun 22 11:45:52.271522 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 47/83] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:52 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:52.535459 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1968df58-969e-478f-bf45-e425de29ac6e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:52.536200 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1968df58-969e-478f-bf45-e425de29ac6e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:52.549969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1968df58-969e-478f-bf45-e425de29ac6e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:52.552751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1968df58-969e-478f-bf45-e425de29ac6e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:52.553762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1968df58-969e-478f-bf45-e425de29ac6e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:52.558829 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1968df58-969e-478f-bf45-e425de29ac6e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:52.776732 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1968df58-969e-478f-bf45-e425de29ac6e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:52.794343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1968df58-969e-478f-bf45-e425de29ac6e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.265513 Jun 22 11:45:52.795462 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 37/84] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:52 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:53.276803 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-838305a3-59fd-4d08-bff9-c61e5babc6fc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:53.277852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-838305a3-59fd-4d08-bff9-c61e5babc6fc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:53.287730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-838305a3-59fd-4d08-bff9-c61e5babc6fc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:53.288375 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-838305a3-59fd-4d08-bff9-c61e5babc6fc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:53.288762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4400db0e-4cf7-4ee6-ba8b-dd9d2352248b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:53.289513 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4400db0e-4cf7-4ee6-ba8b-dd9d2352248b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:53.289607 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-838305a3-59fd-4d08-bff9-c61e5babc6fc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:53.290315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-838305a3-59fd-4d08-bff9-c61e5babc6fc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:53.296053 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4400db0e-4cf7-4ee6-ba8b-dd9d2352248b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:53.296603 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4400db0e-4cf7-4ee6-ba8b-dd9d2352248b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:53.298178 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4400db0e-4cf7-4ee6-ba8b-dd9d2352248b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:53.298723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4400db0e-4cf7-4ee6-ba8b-dd9d2352248b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:53.497726 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4400db0e-4cf7-4ee6-ba8b-dd9d2352248b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:53.507238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4400db0e-4cf7-4ee6-ba8b-dd9d2352248b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.223116 Jun 22 11:45:53.507847 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 38/85] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:53 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:53.508937 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-838305a3-59fd-4d08-bff9-c61e5babc6fc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:53.516560 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-838305a3-59fd-4d08-bff9-c61e5babc6fc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.244216 Jun 22 11:45:53.517394 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 48/86] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:53 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:53.812503 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9be47b9e-901d-484b-85d6-26d939cfcd1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:53.813119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9be47b9e-901d-484b-85d6-26d939cfcd1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:53.819512 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9be47b9e-901d-484b-85d6-26d939cfcd1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:53.819991 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9be47b9e-901d-484b-85d6-26d939cfcd1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:53.820725 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9be47b9e-901d-484b-85d6-26d939cfcd1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:53.821315 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9be47b9e-901d-484b-85d6-26d939cfcd1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:53.971320 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9be47b9e-901d-484b-85d6-26d939cfcd1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:53.978704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9be47b9e-901d-484b-85d6-26d939cfcd1f tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.170812 Jun 22 11:45:53.979462 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 39/87] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:53 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:54.524199 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a4055db8-d20f-45eb-8c7d-de3f31b7ee2f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:54.524809 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a4055db8-d20f-45eb-8c7d-de3f31b7ee2f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:54.531431 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a4055db8-d20f-45eb-8c7d-de3f31b7ee2f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:54.531882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a4055db8-d20f-45eb-8c7d-de3f31b7ee2f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:54.532654 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a4055db8-d20f-45eb-8c7d-de3f31b7ee2f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:54.533086 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a4055db8-d20f-45eb-8c7d-de3f31b7ee2f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:54.533313 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2e993a43-8f87-47fe-b0bc-65f66d013d89 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:54.534394 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2e993a43-8f87-47fe-b0bc-65f66d013d89 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:54.540551 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2e993a43-8f87-47fe-b0bc-65f66d013d89 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:54.541051 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2e993a43-8f87-47fe-b0bc-65f66d013d89 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:54.541760 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2e993a43-8f87-47fe-b0bc-65f66d013d89 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:54.542190 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2e993a43-8f87-47fe-b0bc-65f66d013d89 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:54.724217 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a4055db8-d20f-45eb-8c7d-de3f31b7ee2f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:54.731707 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a4055db8-d20f-45eb-8c7d-de3f31b7ee2f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.211236 Jun 22 11:45:54.741623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 49/88] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:54 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:54.741790 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2e993a43-8f87-47fe-b0bc-65f66d013d89 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:54.741790 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2e993a43-8f87-47fe-b0bc-65f66d013d89 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.210629 Jun 22 11:45:54.741790 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 40/89] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:54 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:54.996698 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e9917caf-6fd0-482d-b1bb-3d1f49a2dee1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:54.997570 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e9917caf-6fd0-482d-b1bb-3d1f49a2dee1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:55.010157 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e9917caf-6fd0-482d-b1bb-3d1f49a2dee1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:55.010742 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e9917caf-6fd0-482d-b1bb-3d1f49a2dee1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:55.011561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e9917caf-6fd0-482d-b1bb-3d1f49a2dee1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:55.011989 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e9917caf-6fd0-482d-b1bb-3d1f49a2dee1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:55.156005 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e9917caf-6fd0-482d-b1bb-3d1f49a2dee1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:55.165264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e9917caf-6fd0-482d-b1bb-3d1f49a2dee1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.172406 Jun 22 11:45:55.166184 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 50/90] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:54 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:55.749520 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0a53385c-914e-4a70-9b74-5183174b0294 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:55.750641 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0a53385c-914e-4a70-9b74-5183174b0294 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:55.756738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a53385c-914e-4a70-9b74-5183174b0294 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:55.756957 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0feb02a3-8d0f-40fb-8a0c-827f3ce63210 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:55.757361 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a53385c-914e-4a70-9b74-5183174b0294 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:55.757528 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0feb02a3-8d0f-40fb-8a0c-827f3ce63210 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:55.757924 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a53385c-914e-4a70-9b74-5183174b0294 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:55.758355 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a53385c-914e-4a70-9b74-5183174b0294 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:55.763530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0feb02a3-8d0f-40fb-8a0c-827f3ce63210 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:55.763976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0feb02a3-8d0f-40fb-8a0c-827f3ce63210 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:55.764731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0feb02a3-8d0f-40fb-8a0c-827f3ce63210 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:55.765156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0feb02a3-8d0f-40fb-8a0c-827f3ce63210 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:55.954068 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0feb02a3-8d0f-40fb-8a0c-827f3ce63210 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:55.956733 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0a53385c-914e-4a70-9b74-5183174b0294 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:55.962702 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0feb02a3-8d0f-40fb-8a0c-827f3ce63210 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.209622 Jun 22 11:45:55.963700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 51/91] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:55 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:55.964249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0a53385c-914e-4a70-9b74-5183174b0294 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.218607 Jun 22 11:45:55.965051 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 41/92] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:55 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:56.182515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0ed185ce-cc55-4196-b196-9d8f797eb8ba tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:56.183252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0ed185ce-cc55-4196-b196-9d8f797eb8ba tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:56.189884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ed185ce-cc55-4196-b196-9d8f797eb8ba tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:56.190336 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ed185ce-cc55-4196-b196-9d8f797eb8ba tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:56.191098 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ed185ce-cc55-4196-b196-9d8f797eb8ba tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:56.191567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ed185ce-cc55-4196-b196-9d8f797eb8ba tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:56.209205 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:56.320119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0ed185ce-cc55-4196-b196-9d8f797eb8ba tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:56.327518 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0ed185ce-cc55-4196-b196-9d8f797eb8ba tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.149395 Jun 22 11:45:56.328123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 52/93] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:56 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:56.980961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e04810d7-22cb-420c-ab32-af06eea1691d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:56.981481 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-404bbbe4-d101-49ba-8b38-25eb2b11c313 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:56.982066 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e04810d7-22cb-420c-ab32-af06eea1691d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:56.982166 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-404bbbe4-d101-49ba-8b38-25eb2b11c313 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:56.988224 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-404bbbe4-d101-49ba-8b38-25eb2b11c313 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:56.988499 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e04810d7-22cb-420c-ab32-af06eea1691d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:56.988662 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-404bbbe4-d101-49ba-8b38-25eb2b11c313 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:56.988946 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e04810d7-22cb-420c-ab32-af06eea1691d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:56.989412 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-404bbbe4-d101-49ba-8b38-25eb2b11c313 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:56.989703 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e04810d7-22cb-420c-ab32-af06eea1691d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:56.989837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-404bbbe4-d101-49ba-8b38-25eb2b11c313 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:56.990131 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e04810d7-22cb-420c-ab32-af06eea1691d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:57.352507 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-404bbbe4-d101-49ba-8b38-25eb2b11c313 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:57.359164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e04810d7-22cb-420c-ab32-af06eea1691d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:57.360177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-404bbbe4-d101-49ba-8b38-25eb2b11c313 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.382555 Jun 22 11:45:57.360748 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 53/94] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:56 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:57.365202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-18aefec9-4fce-4098-b3b5-cb84a7930f6a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:57.365809 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-18aefec9-4fce-4098-b3b5-cb84a7930f6a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:57.366598 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e04810d7-22cb-420c-ab32-af06eea1691d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.390310 Jun 22 11:45:57.367155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 42/95] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:56 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:57.372011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-18aefec9-4fce-4098-b3b5-cb84a7930f6a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:57.372459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-18aefec9-4fce-4098-b3b5-cb84a7930f6a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:57.373230 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-18aefec9-4fce-4098-b3b5-cb84a7930f6a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:57.373663 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-18aefec9-4fce-4098-b3b5-cb84a7930f6a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:57.504315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-18aefec9-4fce-4098-b3b5-cb84a7930f6a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:57.511651 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-18aefec9-4fce-4098-b3b5-cb84a7930f6a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.149925 Jun 22 11:45:57.512225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 54/96] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:57 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:58.377237 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9ec44e46-8db0-4505-a4f6-8e270b1e4165 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:58.377820 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9ec44e46-8db0-4505-a4f6-8e270b1e4165 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:58.383601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a6fdedf8-7c72-4897-b976-36b45e8169e3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:58.384033 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ec44e46-8db0-4505-a4f6-8e270b1e4165 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:58.384310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ec44e46-8db0-4505-a4f6-8e270b1e4165 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:58.384402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a6fdedf8-7c72-4897-b976-36b45e8169e3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:58.385059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ec44e46-8db0-4505-a4f6-8e270b1e4165 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:58.385851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ec44e46-8db0-4505-a4f6-8e270b1e4165 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:58.389799 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:45:58.391088 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a6fdedf8-7c72-4897-b976-36b45e8169e3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:58.391574 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a6fdedf8-7c72-4897-b976-36b45e8169e3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:58.392607 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a6fdedf8-7c72-4897-b976-36b45e8169e3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:58.393036 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a6fdedf8-7c72-4897-b976-36b45e8169e3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:58.574973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9ec44e46-8db0-4505-a4f6-8e270b1e4165 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:58.584413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9ec44e46-8db0-4505-a4f6-8e270b1e4165 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.211294 Jun 22 11:45:58.584986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 43/97] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:58 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:58.589177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a6fdedf8-7c72-4897-b976-36b45e8169e3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:58.594643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d096471d-ac6a-4a03-9f79-32afb8727f0d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:58.595479 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d096471d-ac6a-4a03-9f79-32afb8727f0d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:58.597151 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a6fdedf8-7c72-4897-b976-36b45e8169e3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.217257 Jun 22 11:45:58.597720 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 55/98] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:58 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:58.603715 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d096471d-ac6a-4a03-9f79-32afb8727f0d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:58.604202 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d096471d-ac6a-4a03-9f79-32afb8727f0d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:58.604971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d096471d-ac6a-4a03-9f79-32afb8727f0d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:58.605495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d096471d-ac6a-4a03-9f79-32afb8727f0d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:58.693416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-87352bf9-24e3-4d54-84de-c4a9e65b2b7b req-bd5a6a4f-18f8-436d-a361-f9dfd8790aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1581a659-3e36-43de-ac70-26d15c41f86e", "name": "network-vif-plugged", "status": "completed", "tag": "cf6ccaa0-4359-4273-b639-c746e0759b41"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:45:58.704564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-87352bf9-24e3-4d54-84de-c4a9e65b2b7b req-bd5a6a4f-18f8-436d-a361-f9dfd8790aa2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:58.705245 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-87352bf9-24e3-4d54-84de-c4a9e65b2b7b req-bd5a6a4f-18f8-436d-a361-f9dfd8790aa2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:58.717032 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-87352bf9-24e3-4d54-84de-c4a9e65b2b7b req-bd5a6a4f-18f8-436d-a361-f9dfd8790aa2 service nova] Creating event network-vif-plugged:cf6ccaa0-4359-4273-b639-c746e0759b41 for instance 1581a659-3e36-43de-ac70-26d15c41f86e on hv-cinder-83697 Jun 22 11:45:58.722249 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-87352bf9-24e3-4d54-84de-c4a9e65b2b7b req-bd5a6a4f-18f8-436d-a361-f9dfd8790aa2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033107 Jun 22 11:45:58.722855 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 56/99] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:45:58.741442 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d096471d-ac6a-4a03-9f79-32afb8727f0d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:58.748901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d096471d-ac6a-4a03-9f79-32afb8727f0d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.162801 Jun 22 11:45:58.749471 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 44/100] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:58 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:59.601961 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9db07615-a66f-4a0e-ab8f-e5788838c78b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:59.602647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9db07615-a66f-4a0e-ab8f-e5788838c78b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:59.608907 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9db07615-a66f-4a0e-ab8f-e5788838c78b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:59.609996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9db07615-a66f-4a0e-ab8f-e5788838c78b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:59.610780 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9db07615-a66f-4a0e-ab8f-e5788838c78b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:59.611210 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9db07615-a66f-4a0e-ab8f-e5788838c78b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:59.614907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f4e2897f-67e0-450e-97e8-76a0d0785c83 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:59.615547 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f4e2897f-67e0-450e-97e8-76a0d0785c83 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:59.621566 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f4e2897f-67e0-450e-97e8-76a0d0785c83 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:59.622006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f4e2897f-67e0-450e-97e8-76a0d0785c83 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:59.622758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f4e2897f-67e0-450e-97e8-76a0d0785c83 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:59.623184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f4e2897f-67e0-450e-97e8-76a0d0785c83 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:59.816131 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9db07615-a66f-4a0e-ab8f-e5788838c78b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:59.822997 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f4e2897f-67e0-450e-97e8-76a0d0785c83 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:59.823477 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9db07615-a66f-4a0e-ab8f-e5788838c78b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.225712 Jun 22 11:45:59.824044 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 57/101] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:59 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:45:59.831743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-646a0a32-3a84-4f7f-8e3e-c041332a8ade tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:45:59.831743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-646a0a32-3a84-4f7f-8e3e-c041332a8ade tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:45:59.831981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f4e2897f-67e0-450e-97e8-76a0d0785c83 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.219917 Jun 22 11:45:59.831981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 45/102] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:59 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:45:59.835890 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-646a0a32-3a84-4f7f-8e3e-c041332a8ade tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:59.836472 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-646a0a32-3a84-4f7f-8e3e-c041332a8ade tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:59.837334 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-646a0a32-3a84-4f7f-8e3e-c041332a8ade tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:45:59.837830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-646a0a32-3a84-4f7f-8e3e-c041332a8ade tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:45:59.971049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-646a0a32-3a84-4f7f-8e3e-c041332a8ade tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:45:59.978424 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-646a0a32-3a84-4f7f-8e3e-c041332a8ade tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.153455 Jun 22 11:45:59.979007 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 58/103] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:45:59 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:00.841458 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d469bd9b-9d60-4d6f-8367-8840e487cc9e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:00.842068 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d469bd9b-9d60-4d6f-8367-8840e487cc9e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:00.848406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7f5afb0c-d8a3-4230-8001-121addca0970 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:00.848866 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d469bd9b-9d60-4d6f-8367-8840e487cc9e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:00.849122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7f5afb0c-d8a3-4230-8001-121addca0970 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:00.849292 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d469bd9b-9d60-4d6f-8367-8840e487cc9e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:00.850503 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d469bd9b-9d60-4d6f-8367-8840e487cc9e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:00.850503 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d469bd9b-9d60-4d6f-8367-8840e487cc9e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:00.855567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7f5afb0c-d8a3-4230-8001-121addca0970 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:00.856013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7f5afb0c-d8a3-4230-8001-121addca0970 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:00.856781 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7f5afb0c-d8a3-4230-8001-121addca0970 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:00.857211 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7f5afb0c-d8a3-4230-8001-121addca0970 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:01.061824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d469bd9b-9d60-4d6f-8367-8840e487cc9e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:01.065740 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7f5afb0c-d8a3-4230-8001-121addca0970 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:01.070148 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d469bd9b-9d60-4d6f-8367-8840e487cc9e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.232424 Jun 22 11:46:01.070805 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 46/104] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:00 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:01.073598 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7f5afb0c-d8a3-4230-8001-121addca0970 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.228937 Jun 22 11:46:01.074361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 59/105] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:00 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:01.075894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5791299f-0fbd-499c-bf8a-71d37a5c824c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:01.076504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5791299f-0fbd-499c-bf8a-71d37a5c824c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:01.082612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5791299f-0fbd-499c-bf8a-71d37a5c824c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:01.083059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5791299f-0fbd-499c-bf8a-71d37a5c824c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:01.083970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5791299f-0fbd-499c-bf8a-71d37a5c824c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:01.084525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5791299f-0fbd-499c-bf8a-71d37a5c824c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:01.222760 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5791299f-0fbd-499c-bf8a-71d37a5c824c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:01.231541 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5791299f-0fbd-499c-bf8a-71d37a5c824c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.159457 Jun 22 11:46:01.232141 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 47/106] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:01 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:02.090709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-32a60a07-3b53-4570-a032-40e2ec999c09 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:02.091416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-32a60a07-3b53-4570-a032-40e2ec999c09 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:02.091932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-09a0b60c-b0bf-49c4-9c25-11030aa3c27c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:02.092543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-09a0b60c-b0bf-49c4-9c25-11030aa3c27c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:02.098013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-32a60a07-3b53-4570-a032-40e2ec999c09 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:02.098560 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-32a60a07-3b53-4570-a032-40e2ec999c09 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:02.099401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-32a60a07-3b53-4570-a032-40e2ec999c09 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:02.099898 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-32a60a07-3b53-4570-a032-40e2ec999c09 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:02.101590 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-09a0b60c-b0bf-49c4-9c25-11030aa3c27c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:02.102043 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-09a0b60c-b0bf-49c4-9c25-11030aa3c27c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:02.102806 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-09a0b60c-b0bf-49c4-9c25-11030aa3c27c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:02.103234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-09a0b60c-b0bf-49c4-9c25-11030aa3c27c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:02.306758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-32a60a07-3b53-4570-a032-40e2ec999c09 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:02.315879 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-32a60a07-3b53-4570-a032-40e2ec999c09 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.229419 Jun 22 11:46:02.316455 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 60/107] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:02 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:02.325032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-09a0b60c-b0bf-49c4-9c25-11030aa3c27c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:02.329511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1a292ce3-8750-4708-a999-660d237192a9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:02.330217 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1a292ce3-8750-4708-a999-660d237192a9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:02.333302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-09a0b60c-b0bf-49c4-9c25-11030aa3c27c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.245234 Jun 22 11:46:02.333896 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 48/108] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:02 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:02.339312 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a292ce3-8750-4708-a999-660d237192a9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:02.339998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a292ce3-8750-4708-a999-660d237192a9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:02.340917 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a292ce3-8750-4708-a999-660d237192a9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:02.341504 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a292ce3-8750-4708-a999-660d237192a9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:02.586188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1a292ce3-8750-4708-a999-660d237192a9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:02.593834 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1a292ce3-8750-4708-a999-660d237192a9 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.276232 Jun 22 11:46:02.594387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 61/109] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:02 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:03.333224 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-20820ed1-e1b5-4869-9f19-7eaa8ef57f1b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:03.333817 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-20820ed1-e1b5-4869-9f19-7eaa8ef57f1b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:03.340110 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-20820ed1-e1b5-4869-9f19-7eaa8ef57f1b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:03.340561 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-20820ed1-e1b5-4869-9f19-7eaa8ef57f1b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:03.341391 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-20820ed1-e1b5-4869-9f19-7eaa8ef57f1b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:03.341963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-20820ed1-e1b5-4869-9f19-7eaa8ef57f1b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:03.353865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6137e185-6d5d-4db8-9e76-385a495eecaa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:03.354565 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6137e185-6d5d-4db8-9e76-385a495eecaa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:03.362548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6137e185-6d5d-4db8-9e76-385a495eecaa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:03.363058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6137e185-6d5d-4db8-9e76-385a495eecaa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:03.364726 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6137e185-6d5d-4db8-9e76-385a495eecaa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:03.365404 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6137e185-6d5d-4db8-9e76-385a495eecaa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:03.553946 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-20820ed1-e1b5-4869-9f19-7eaa8ef57f1b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:03.561895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-20820ed1-e1b5-4869-9f19-7eaa8ef57f1b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.232322 Jun 22 11:46:03.562455 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 49/110] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:03 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:03.580633 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6137e185-6d5d-4db8-9e76-385a495eecaa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:03.590265 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6137e185-6d5d-4db8-9e76-385a495eecaa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.241554 Jun 22 11:46:03.598110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 62/111] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:03 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:03.613001 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c1e1f590-8bb4-43a6-b7b6-af622c0fa54c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:03.613607 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c1e1f590-8bb4-43a6-b7b6-af622c0fa54c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:03.621580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c1e1f590-8bb4-43a6-b7b6-af622c0fa54c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:03.622120 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c1e1f590-8bb4-43a6-b7b6-af622c0fa54c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:03.623101 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c1e1f590-8bb4-43a6-b7b6-af622c0fa54c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:03.623556 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c1e1f590-8bb4-43a6-b7b6-af622c0fa54c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:03.790645 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c1e1f590-8bb4-43a6-b7b6-af622c0fa54c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:03.800929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c1e1f590-8bb4-43a6-b7b6-af622c0fa54c tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.192575 Jun 22 11:46:03.819829 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 50/112] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:03 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:04.577856 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5bf73b6b-7cdb-436d-b8a7-a8d4282ff812 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:04.579020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5bf73b6b-7cdb-436d-b8a7-a8d4282ff812 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:04.585389 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5bf73b6b-7cdb-436d-b8a7-a8d4282ff812 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:04.585886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5bf73b6b-7cdb-436d-b8a7-a8d4282ff812 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:04.586825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5bf73b6b-7cdb-436d-b8a7-a8d4282ff812 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:04.587248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5bf73b6b-7cdb-436d-b8a7-a8d4282ff812 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:04.606403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2b87b067-0176-43b3-b4ea-6226866fc54b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:04.607632 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2b87b067-0176-43b3-b4ea-6226866fc54b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:04.627487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b87b067-0176-43b3-b4ea-6226866fc54b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:04.627932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b87b067-0176-43b3-b4ea-6226866fc54b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:04.628699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b87b067-0176-43b3-b4ea-6226866fc54b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:04.629124 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b87b067-0176-43b3-b4ea-6226866fc54b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:04.845241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5bf73b6b-7cdb-436d-b8a7-a8d4282ff812 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:04.853550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5bf73b6b-7cdb-436d-b8a7-a8d4282ff812 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.279209 Jun 22 11:46:04.854651 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 63/113] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:04 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:04.860049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c6dfadc3-1a13-46db-a734-b1ed7f8c15cd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:04.860842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c6dfadc3-1a13-46db-a734-b1ed7f8c15cd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:04.867026 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2b87b067-0176-43b3-b4ea-6226866fc54b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:04.867857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c6dfadc3-1a13-46db-a734-b1ed7f8c15cd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:04.868483 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c6dfadc3-1a13-46db-a734-b1ed7f8c15cd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:04.869553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c6dfadc3-1a13-46db-a734-b1ed7f8c15cd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:04.870472 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c6dfadc3-1a13-46db-a734-b1ed7f8c15cd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:04.876877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2b87b067-0176-43b3-b4ea-6226866fc54b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.274195 Jun 22 11:46:04.888142 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 51/114] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:04 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:05.021949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c6dfadc3-1a13-46db-a734-b1ed7f8c15cd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:05.037575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c6dfadc3-1a13-46db-a734-b1ed7f8c15cd tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.175211 Jun 22 11:46:05.037575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 64/115] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:04 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:05.872310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7d98c23f-d1c4-4ada-9b31-f180e5d79945 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:05.872924 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7d98c23f-d1c4-4ada-9b31-f180e5d79945 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:05.879555 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d98c23f-d1c4-4ada-9b31-f180e5d79945 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:05.880006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d98c23f-d1c4-4ada-9b31-f180e5d79945 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:05.880769 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d98c23f-d1c4-4ada-9b31-f180e5d79945 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:05.881203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d98c23f-d1c4-4ada-9b31-f180e5d79945 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:05.895601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-91624ba6-5f26-4d25-a72b-9404462f534b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:05.896205 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-91624ba6-5f26-4d25-a72b-9404462f534b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:05.903122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91624ba6-5f26-4d25-a72b-9404462f534b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:05.903599 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91624ba6-5f26-4d25-a72b-9404462f534b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:05.904492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91624ba6-5f26-4d25-a72b-9404462f534b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:05.904921 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91624ba6-5f26-4d25-a72b-9404462f534b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:06.089727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7d98c23f-d1c4-4ada-9b31-f180e5d79945 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:06.110248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-91624ba6-5f26-4d25-a72b-9404462f534b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:06.119550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-91624ba6-5f26-4d25-a72b-9404462f534b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.228014 Jun 22 11:46:06.120124 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 65/116] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:05 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:06.131013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7d98c23f-d1c4-4ada-9b31-f180e5d79945 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.262530 Jun 22 11:46:06.132146 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 52/117] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:05 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:06.142236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-db988392-64a2-401d-8900-270cd6559d00 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:06.142874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-db988392-64a2-401d-8900-270cd6559d00 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:06.148861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db988392-64a2-401d-8900-270cd6559d00 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:06.149302 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db988392-64a2-401d-8900-270cd6559d00 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:06.150135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db988392-64a2-401d-8900-270cd6559d00 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:06.150529 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db988392-64a2-401d-8900-270cd6559d00 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:06.312783 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-db988392-64a2-401d-8900-270cd6559d00 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:06.320597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-db988392-64a2-401d-8900-270cd6559d00 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.187605 Jun 22 11:46:06.321154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 66/118] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:06 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:07.136347 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d1906252-0a10-4ce9-9a8b-47aa7a02e29d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:07.137599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d1906252-0a10-4ce9-9a8b-47aa7a02e29d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:07.145517 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d1906252-0a10-4ce9-9a8b-47aa7a02e29d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:07.146262 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d1906252-0a10-4ce9-9a8b-47aa7a02e29d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:07.147307 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d1906252-0a10-4ce9-9a8b-47aa7a02e29d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:07.147966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d1906252-0a10-4ce9-9a8b-47aa7a02e29d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:07.151139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0532dbb7-2966-4bd8-abc9-ba1aded67a9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:07.151837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0532dbb7-2966-4bd8-abc9-ba1aded67a9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:07.154558 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=78 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:07.160160 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0532dbb7-2966-4bd8-abc9-ba1aded67a9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:07.160691 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0532dbb7-2966-4bd8-abc9-ba1aded67a9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:07.162988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0532dbb7-2966-4bd8-abc9-ba1aded67a9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:07.163785 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0532dbb7-2966-4bd8-abc9-ba1aded67a9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:07.395545 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d1906252-0a10-4ce9-9a8b-47aa7a02e29d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:07.408613 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d1906252-0a10-4ce9-9a8b-47aa7a02e29d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.273908 Jun 22 11:46:07.417964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 53/119] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:07 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:07.420160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ffdb31d5-0704-4777-8834-d89a284261c7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:07.420783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ffdb31d5-0704-4777-8834-d89a284261c7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:07.429255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ffdb31d5-0704-4777-8834-d89a284261c7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:07.429696 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ffdb31d5-0704-4777-8834-d89a284261c7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:07.430467 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ffdb31d5-0704-4777-8834-d89a284261c7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:07.430966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ffdb31d5-0704-4777-8834-d89a284261c7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:07.466860 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0532dbb7-2966-4bd8-abc9-ba1aded67a9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:07.475246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0532dbb7-2966-4bd8-abc9-ba1aded67a9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.328921 Jun 22 11:46:07.475846 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 67/120] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:07 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:07.544356 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-701514661", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "networks": [{"uuid": "b4da61dd-cd35-4f64-a49a-6bcce41decb3"}]}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:07.617808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] validate_networks() for [('b4da61dd-cd35-4f64-a49a-6bcce41decb3', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:46:07.640111 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ffdb31d5-0704-4777-8834-d89a284261c7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:07.649847 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ffdb31d5-0704-4777-8834-d89a284261c7 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.236336 Jun 22 11:46:07.650630 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 54/121] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:07 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:08.164055 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-38ac3b56-6323-4673-9215-222064cc4553 req-2ddd41c8-8a3e-46cb-be75-d3789a150447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6ebc0a-848b-4688-939a-062ccc6dc352", "name": "network-vif-plugged", "status": "completed", "tag": "f2a96738-75af-44d5-9821-e335309678f0"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:08.180482 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-38ac3b56-6323-4673-9215-222064cc4553 req-2ddd41c8-8a3e-46cb-be75-d3789a150447 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.181051 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-38ac3b56-6323-4673-9215-222064cc4553 req-2ddd41c8-8a3e-46cb-be75-d3789a150447 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.198491 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-38ac3b56-6323-4673-9215-222064cc4553 req-2ddd41c8-8a3e-46cb-be75-d3789a150447 service nova] Creating event network-vif-plugged:f2a96738-75af-44d5-9821-e335309678f0 for instance af6ebc0a-848b-4688-939a-062ccc6dc352 on hv-cinder-83697 Jun 22 11:46:08.206922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-38ac3b56-6323-4673-9215-222064cc4553 req-2ddd41c8-8a3e-46cb-be75-d3789a150447 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047835 Jun 22 11:46:08.208051 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 55/122] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:46:08.244045 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:46:08.244685 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:46:08.245122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:46:08.245502 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:46:08.245974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:46:08.258512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.259279 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.260310 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.261048 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.295938 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Getting quotas for project 97d7e536c4254f469c6da669481eb8e6. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:46:08.301819 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Getting quotas for user 72365998f1bb459cbff28ca0b267fe69 and project 97d7e536c4254f469c6da669481eb8e6. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:46:08.315264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:46:08.318410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:46:08.375993 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b8582ef5-9615-46b8-a0a6-b4b23b503001 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836473 Jun 22 11:46:08.376793 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 68/123] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 11:46:08.392488 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c0953705-5948-476d-97cb-887216601b99 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:08.393740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c0953705-5948-476d-97cb-887216601b99 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:08.427286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e83fa7e5-3f94-41ce-ac0f-1f91b5d4026e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:08.428504 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e83fa7e5-3f94-41ce-ac0f-1f91b5d4026e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:08.443598 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e83fa7e5-3f94-41ce-ac0f-1f91b5d4026e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.444131 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e83fa7e5-3f94-41ce-ac0f-1f91b5d4026e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.445247 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e83fa7e5-3f94-41ce-ac0f-1f91b5d4026e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.445822 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e83fa7e5-3f94-41ce-ac0f-1f91b5d4026e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.498347 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c0953705-5948-476d-97cb-887216601b99 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:08.509220 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c0953705-5948-476d-97cb-887216601b99 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1213 microversion: 2.1 time: 0.121927 Jun 22 11:46:08.520925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 56/124] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:08 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1213 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:08.526469 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3c6e3a48-57a8-4a11-9282-86dd515f4bf0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:08.527220 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3c6e3a48-57a8-4a11-9282-86dd515f4bf0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:08.538454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c6e3a48-57a8-4a11-9282-86dd515f4bf0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.539023 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c6e3a48-57a8-4a11-9282-86dd515f4bf0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.539909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c6e3a48-57a8-4a11-9282-86dd515f4bf0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.540332 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c6e3a48-57a8-4a11-9282-86dd515f4bf0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.857765 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e83fa7e5-3f94-41ce-ac0f-1f91b5d4026e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:08.871573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e83fa7e5-3f94-41ce-ac0f-1f91b5d4026e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.445329 Jun 22 11:46:08.872632 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 69/125] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:08 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:08.879918 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f262d862-38e9-4712-92fd-621c2cb4ede3 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:08.880757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f262d862-38e9-4712-92fd-621c2cb4ede3 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:08.889123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f262d862-38e9-4712-92fd-621c2cb4ede3 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.889638 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f262d862-38e9-4712-92fd-621c2cb4ede3 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.891011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f262d862-38e9-4712-92fd-621c2cb4ede3 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:08.891440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f262d862-38e9-4712-92fd-621c2cb4ede3 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:08.919828 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:08.963334 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3c6e3a48-57a8-4a11-9282-86dd515f4bf0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:08.972198 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3c6e3a48-57a8-4a11-9282-86dd515f4bf0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.450125 Jun 22 11:46:08.983273 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 57/126] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:08 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:09.306739 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f262d862-38e9-4712-92fd-621c2cb4ede3 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:09.316014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f262d862-38e9-4712-92fd-621c2cb4ede3 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.441980 Jun 22 11:46:09.316799 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 70/127] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:08 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:09.528455 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ef77d2e1-8545-4e64-9afe-3f286b4a1681 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:09.529187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ef77d2e1-8545-4e64-9afe-3f286b4a1681 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:09.540663 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ef77d2e1-8545-4e64-9afe-3f286b4a1681 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:09.541115 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ef77d2e1-8545-4e64-9afe-3f286b4a1681 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:09.542062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ef77d2e1-8545-4e64-9afe-3f286b4a1681 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:09.542670 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ef77d2e1-8545-4e64-9afe-3f286b4a1681 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:09.610932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ef77d2e1-8545-4e64-9afe-3f286b4a1681 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:09.621706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ef77d2e1-8545-4e64-9afe-3f286b4a1681 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1217 microversion: 2.1 time: 0.098901 Jun 22 11:46:09.623428 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 58/128] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:09 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:09.889899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ac747d3c-b1cb-4986-a42e-02e276723bbf tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:09.891149 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ac747d3c-b1cb-4986-a42e-02e276723bbf tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:09.898766 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ac747d3c-b1cb-4986-a42e-02e276723bbf tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:09.899209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ac747d3c-b1cb-4986-a42e-02e276723bbf tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:09.900257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ac747d3c-b1cb-4986-a42e-02e276723bbf tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:09.900678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ac747d3c-b1cb-4986-a42e-02e276723bbf tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:10.000866 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-03f60adb-256d-41c3-a46e-c86fc6daaf0d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:10.001719 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-03f60adb-256d-41c3-a46e-c86fc6daaf0d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:10.012809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-03f60adb-256d-41c3-a46e-c86fc6daaf0d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:10.013586 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-03f60adb-256d-41c3-a46e-c86fc6daaf0d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:10.016382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-03f60adb-256d-41c3-a46e-c86fc6daaf0d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:10.018032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-03f60adb-256d-41c3-a46e-c86fc6daaf0d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:10.345273 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ac747d3c-b1cb-4986-a42e-02e276723bbf tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:10.353858 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ac747d3c-b1cb-4986-a42e-02e276723bbf tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.468847 Jun 22 11:46:10.360188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 71/129] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:09 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:10.368159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-91960886-4648-42d0-a1f8-6f96a52a8a5d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:10.370743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-91960886-4648-42d0-a1f8-6f96a52a8a5d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:10.378101 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91960886-4648-42d0-a1f8-6f96a52a8a5d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:10.378376 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91960886-4648-42d0-a1f8-6f96a52a8a5d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:10.379159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91960886-4648-42d0-a1f8-6f96a52a8a5d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:10.379727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91960886-4648-42d0-a1f8-6f96a52a8a5d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:10.407630 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-03f60adb-256d-41c3-a46e-c86fc6daaf0d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:10.415231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-03f60adb-256d-41c3-a46e-c86fc6daaf0d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.419580 Jun 22 11:46:10.415832 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 59/130] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:09 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:10.561100 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-91960886-4648-42d0-a1f8-6f96a52a8a5d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:10.569192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-91960886-4648-42d0-a1f8-6f96a52a8a5d tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1315 microversion: 2.1 time: 0.207764 Jun 22 11:46:10.569764 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 72/131] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:10 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:10.637856 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7d8ad0cc-7f78-4fdd-9136-dffb0b2dd235 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:10.638533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7d8ad0cc-7f78-4fdd-9136-dffb0b2dd235 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:10.644766 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d8ad0cc-7f78-4fdd-9136-dffb0b2dd235 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:10.645201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d8ad0cc-7f78-4fdd-9136-dffb0b2dd235 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:10.645957 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d8ad0cc-7f78-4fdd-9136-dffb0b2dd235 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:10.646376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d8ad0cc-7f78-4fdd-9136-dffb0b2dd235 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:10.730430 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7d8ad0cc-7f78-4fdd-9136-dffb0b2dd235 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:10.739519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7d8ad0cc-7f78-4fdd-9136-dffb0b2dd235 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1209 microversion: 2.1 time: 0.105139 Jun 22 11:46:10.740797 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 60/132] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:10 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1209 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:11.376501 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6cd50857-8804-4171-a176-ba741f94beb5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:11.377234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6cd50857-8804-4171-a176-ba741f94beb5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:11.383265 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6cd50857-8804-4171-a176-ba741f94beb5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:11.383817 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6cd50857-8804-4171-a176-ba741f94beb5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:11.384869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6cd50857-8804-4171-a176-ba741f94beb5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:11.385329 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6cd50857-8804-4171-a176-ba741f94beb5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:11.436013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f032f2bf-65c6-4073-ab43-c9c0142055e7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:11.436891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f032f2bf-65c6-4073-ab43-c9c0142055e7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:11.450204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f032f2bf-65c6-4073-ab43-c9c0142055e7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:11.450815 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f032f2bf-65c6-4073-ab43-c9c0142055e7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:11.451779 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f032f2bf-65c6-4073-ab43-c9c0142055e7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:11.452384 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f032f2bf-65c6-4073-ab43-c9c0142055e7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:11.490535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:11.645140 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6cd50857-8804-4171-a176-ba741f94beb5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:11.655695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6cd50857-8804-4171-a176-ba741f94beb5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.281933 Jun 22 11:46:11.658876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 73/133] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:11 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:11.666610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-24b64a9f-c1b8-4098-a661-8b0a0d4814bb tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:11.667835 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-24b64a9f-c1b8-4098-a661-8b0a0d4814bb tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:11.675552 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-24b64a9f-c1b8-4098-a661-8b0a0d4814bb tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:11.676171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-24b64a9f-c1b8-4098-a661-8b0a0d4814bb tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:11.676937 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-24b64a9f-c1b8-4098-a661-8b0a0d4814bb tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:11.677371 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-24b64a9f-c1b8-4098-a661-8b0a0d4814bb tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:11.752497 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f032f2bf-65c6-4073-ab43-c9c0142055e7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:11.763602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f032f2bf-65c6-4073-ab43-c9c0142055e7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1321 microversion: 2.1 time: 0.331270 Jun 22 11:46:11.764789 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 61/134] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:11 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:11.770966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-990c49e5-3877-4aec-b420-86616f49a741 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:11.772799 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-990c49e5-3877-4aec-b420-86616f49a741 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:11.784103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-990c49e5-3877-4aec-b420-86616f49a741 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:11.784764 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-990c49e5-3877-4aec-b420-86616f49a741 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:11.785734 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-990c49e5-3877-4aec-b420-86616f49a741 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:11.786404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-990c49e5-3877-4aec-b420-86616f49a741 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:11.882469 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-990c49e5-3877-4aec-b420-86616f49a741 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:11.893684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-990c49e5-3877-4aec-b420-86616f49a741 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1209 microversion: 2.1 time: 0.127079 Jun 22 11:46:11.894901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 62/135] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:11 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:11.925831 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-24b64a9f-c1b8-4098-a661-8b0a0d4814bb tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:11.940251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-24b64a9f-c1b8-4098-a661-8b0a0d4814bb tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1503 microversion: 2.1 time: 0.279798 Jun 22 11:46:11.941200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 74/136] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:11 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:12.514107 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-1087dc14-f2ce-4e43-9855-af1084e62513 req-afdc0413-3255-4c53-a74b-19a95898e4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3c3cce-4dbe-44a3-b2df-7e43078812f8", "name": "network-vif-plugged", "status": "completed", "tag": "2a25c2c3-035b-4263-bc42-63433b20fb62"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:12.527608 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-1087dc14-f2ce-4e43-9855-af1084e62513 req-afdc0413-3255-4c53-a74b-19a95898e4d2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:12.528231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-1087dc14-f2ce-4e43-9855-af1084e62513 req-afdc0413-3255-4c53-a74b-19a95898e4d2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:12.544549 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-1087dc14-f2ce-4e43-9855-af1084e62513 req-afdc0413-3255-4c53-a74b-19a95898e4d2 service nova] Creating event network-vif-plugged:2a25c2c3-035b-4263-bc42-63433b20fb62 for instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 on hv-cinder-83697 Jun 22 11:46:12.551721 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-1087dc14-f2ce-4e43-9855-af1084e62513 req-afdc0413-3255-4c53-a74b-19a95898e4d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047180 Jun 22 11:46:12.552992 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 63/137] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:46:12.673324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c379922a-f908-4c52-96c3-b533e49e765b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:12.673932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c379922a-f908-4c52-96c3-b533e49e765b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:12.680288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c379922a-f908-4c52-96c3-b533e49e765b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:12.681974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c379922a-f908-4c52-96c3-b533e49e765b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:12.684154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c379922a-f908-4c52-96c3-b533e49e765b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:12.685501 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c379922a-f908-4c52-96c3-b533e49e765b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:12.782633 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-39f95a05-8bf4-49ca-b463-195a8399ba1c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:12.788601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-39f95a05-8bf4-49ca-b463-195a8399ba1c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:12.797715 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-39f95a05-8bf4-49ca-b463-195a8399ba1c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:12.798451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-39f95a05-8bf4-49ca-b463-195a8399ba1c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:12.800264 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-39f95a05-8bf4-49ca-b463-195a8399ba1c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:12.800695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-39f95a05-8bf4-49ca-b463-195a8399ba1c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:12.920272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c379922a-f908-4c52-96c3-b533e49e765b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:12.937041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c379922a-f908-4c52-96c3-b533e49e765b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.268150 Jun 22 11:46:12.937630 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 75/138] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:12 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:12.951718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a27f0e64-f16e-4dbd-aa15-2218449cdc1b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:12.952355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a27f0e64-f16e-4dbd-aa15-2218449cdc1b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:12.972631 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a27f0e64-f16e-4dbd-aa15-2218449cdc1b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:12.973084 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a27f0e64-f16e-4dbd-aa15-2218449cdc1b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:12.973849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a27f0e64-f16e-4dbd-aa15-2218449cdc1b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:12.974296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a27f0e64-f16e-4dbd-aa15-2218449cdc1b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:13.009025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-39f95a05-8bf4-49ca-b463-195a8399ba1c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:13.020907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-39f95a05-8bf4-49ca-b463-195a8399ba1c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1516 microversion: 2.1 time: 0.242883 Jun 22 11:46:13.022395 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 64/139] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:12 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:13.048956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-aa546848-fb1c-4cd9-8bc9-ca0d1fd2ef23 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:13.050199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-aa546848-fb1c-4cd9-8bc9-ca0d1fd2ef23 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:13.056548 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa546848-fb1c-4cd9-8bc9-ca0d1fd2ef23 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:13.057208 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa546848-fb1c-4cd9-8bc9-ca0d1fd2ef23 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:13.058231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa546848-fb1c-4cd9-8bc9-ca0d1fd2ef23 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:13.058819 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa546848-fb1c-4cd9-8bc9-ca0d1fd2ef23 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:13.074019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a27f0e64-f16e-4dbd-aa15-2218449cdc1b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:13.083807 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a27f0e64-f16e-4dbd-aa15-2218449cdc1b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1209 microversion: 2.1 time: 0.141897 Jun 22 11:46:13.084410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 76/140] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:12 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:13.122834 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-aa546848-fb1c-4cd9-8bc9-ca0d1fd2ef23 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lazy-loading 'flavor' on Instance uuid 1581a659-3e36-43de-ac70-26d15c41f86e {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:46:13.262151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-aa546848-fb1c-4cd9-8bc9-ca0d1fd2ef23 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e/action" status: 200 len: 32 microversion: 2.1 time: 0.213952 Jun 22 11:46:13.262660 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 65/141] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:46:13 2022] POST /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e/action => generated 32 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 11:46:13.267959 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-df7ea04b-b8ce-4959-863f-8de5f28715de tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:13.268983 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-df7ea04b-b8ce-4959-863f-8de5f28715de tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:13.283911 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-df7ea04b-b8ce-4959-863f-8de5f28715de tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:13.284362 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-df7ea04b-b8ce-4959-863f-8de5f28715de tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:13.285149 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-df7ea04b-b8ce-4959-863f-8de5f28715de tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:13.285596 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-df7ea04b-b8ce-4959-863f-8de5f28715de tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:13.444195 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-df7ea04b-b8ce-4959-863f-8de5f28715de tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:13.451903 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-df7ea04b-b8ce-4959-863f-8de5f28715de tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.188325 Jun 22 11:46:13.452883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 77/142] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:13 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:13.460745 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d3a4cab4-c190-4b78-b9ef-593e126b3126 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f1265c7-7a6f-4659-8510-0edc7ff791e7"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:13.462112 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d3a4cab4-c190-4b78-b9ef-593e126b3126 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:13.469464 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3a4cab4-c190-4b78-b9ef-593e126b3126 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:13.470064 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3a4cab4-c190-4b78-b9ef-593e126b3126 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:13.471006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3a4cab4-c190-4b78-b9ef-593e126b3126 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:13.471452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3a4cab4-c190-4b78-b9ef-593e126b3126 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:13.953867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4c5bd7b1-6c5e-47ed-b44a-d8f19cc4fffa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:13.954546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4c5bd7b1-6c5e-47ed-b44a-d8f19cc4fffa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:13.961785 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4c5bd7b1-6c5e-47ed-b44a-d8f19cc4fffa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:13.962231 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4c5bd7b1-6c5e-47ed-b44a-d8f19cc4fffa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:13.963025 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4c5bd7b1-6c5e-47ed-b44a-d8f19cc4fffa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:13.963484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4c5bd7b1-6c5e-47ed-b44a-d8f19cc4fffa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:14.096674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4c5bd7b1-6c5e-47ed-b44a-d8f19cc4fffa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:14.104377 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4c5bd7b1-6c5e-47ed-b44a-d8f19cc4fffa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.154222 Jun 22 11:46:14.104949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 78/143] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:13 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:14.110297 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-73d5be4d-c746-46ca-b48b-8c486d76bfab tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:14.111171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-73d5be4d-c746-46ca-b48b-8c486d76bfab tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:14.118704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-73d5be4d-c746-46ca-b48b-8c486d76bfab tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:14.119178 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-73d5be4d-c746-46ca-b48b-8c486d76bfab tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:14.119955 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-73d5be4d-c746-46ca-b48b-8c486d76bfab tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:14.120385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-73d5be4d-c746-46ca-b48b-8c486d76bfab tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:14.191876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-73d5be4d-c746-46ca-b48b-8c486d76bfab tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:14.200328 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-73d5be4d-c746-46ca-b48b-8c486d76bfab tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1209 microversion: 2.1 time: 0.094208 Jun 22 11:46:14.200911 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 79/144] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:14 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:14.470061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1fd35f26-7d54-4e87-86a1-b6610dcd65d6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:14.470664 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1fd35f26-7d54-4e87-86a1-b6610dcd65d6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:14.476627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1fd35f26-7d54-4e87-86a1-b6610dcd65d6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:14.477063 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1fd35f26-7d54-4e87-86a1-b6610dcd65d6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:14.477814 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1fd35f26-7d54-4e87-86a1-b6610dcd65d6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:14.478236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1fd35f26-7d54-4e87-86a1-b6610dcd65d6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:14.612253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1fd35f26-7d54-4e87-86a1-b6610dcd65d6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:14.620041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1fd35f26-7d54-4e87-86a1-b6610dcd65d6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.154344 Jun 22 11:46:14.620700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 80/145] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:14 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:15.121626 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-22c1905a-3303-425c-9fd9-d89fc8269dfe tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:15.122226 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-22c1905a-3303-425c-9fd9-d89fc8269dfe tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:15.128859 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-22c1905a-3303-425c-9fd9-d89fc8269dfe tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:15.129308 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-22c1905a-3303-425c-9fd9-d89fc8269dfe tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:15.130078 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-22c1905a-3303-425c-9fd9-d89fc8269dfe tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:15.130516 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-22c1905a-3303-425c-9fd9-d89fc8269dfe tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:15.262796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-22c1905a-3303-425c-9fd9-d89fc8269dfe tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:15.271110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-22c1905a-3303-425c-9fd9-d89fc8269dfe tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.153241 Jun 22 11:46:15.271714 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 81/146] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:15 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:15.276190 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-08b46148-4004-4c91-8c7a-cde50e7e1b6b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:15.276807 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-08b46148-4004-4c91-8c7a-cde50e7e1b6b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:15.282835 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08b46148-4004-4c91-8c7a-cde50e7e1b6b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:15.283284 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08b46148-4004-4c91-8c7a-cde50e7e1b6b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:15.284080 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08b46148-4004-4c91-8c7a-cde50e7e1b6b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:15.284541 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08b46148-4004-4c91-8c7a-cde50e7e1b6b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:15.346471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-08b46148-4004-4c91-8c7a-cde50e7e1b6b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:15.354014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-08b46148-4004-4c91-8c7a-cde50e7e1b6b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1209 microversion: 2.1 time: 0.081329 Jun 22 11:46:15.354561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 82/147] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:15 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:15.637056 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ba5a9bf0-e188-4bb4-ba92-ce70438a858e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:15.637657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ba5a9bf0-e188-4bb4-ba92-ce70438a858e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:15.644021 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba5a9bf0-e188-4bb4-ba92-ce70438a858e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:15.644469 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba5a9bf0-e188-4bb4-ba92-ce70438a858e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:15.645228 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba5a9bf0-e188-4bb4-ba92-ce70438a858e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:15.645657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba5a9bf0-e188-4bb4-ba92-ce70438a858e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:15.780086 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ba5a9bf0-e188-4bb4-ba92-ce70438a858e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:15.788115 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ba5a9bf0-e188-4bb4-ba92-ce70438a858e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.154943 Jun 22 11:46:15.788683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 83/148] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:15 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:16.287967 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ec85fabf-707b-42bb-b78e-fae825286b2d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:16.288630 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ec85fabf-707b-42bb-b78e-fae825286b2d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:16.294627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec85fabf-707b-42bb-b78e-fae825286b2d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:16.295077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec85fabf-707b-42bb-b78e-fae825286b2d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:16.295867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec85fabf-707b-42bb-b78e-fae825286b2d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:16.296796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec85fabf-707b-42bb-b78e-fae825286b2d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:16.426899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ec85fabf-707b-42bb-b78e-fae825286b2d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:16.434300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ec85fabf-707b-42bb-b78e-fae825286b2d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.150389 Jun 22 11:46:16.434864 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 84/149] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:16 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:16.439975 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2ff53df3-c84a-42dd-a1ad-d2b5f416fa90 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:16.440570 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2ff53df3-c84a-42dd-a1ad-d2b5f416fa90 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:16.446471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2ff53df3-c84a-42dd-a1ad-d2b5f416fa90 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:16.446911 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2ff53df3-c84a-42dd-a1ad-d2b5f416fa90 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:16.447688 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2ff53df3-c84a-42dd-a1ad-d2b5f416fa90 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:16.448111 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2ff53df3-c84a-42dd-a1ad-d2b5f416fa90 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:16.509001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2ff53df3-c84a-42dd-a1ad-d2b5f416fa90 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:16.517231 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2ff53df3-c84a-42dd-a1ad-d2b5f416fa90 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1209 microversion: 2.1 time: 0.081037 Jun 22 11:46:16.517776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 85/150] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:16 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:16.805256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b4ce75a4-920f-4f91-ad28-e256f00dbbf6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:16.805852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b4ce75a4-920f-4f91-ad28-e256f00dbbf6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:16.811769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4ce75a4-920f-4f91-ad28-e256f00dbbf6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:16.812213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4ce75a4-920f-4f91-ad28-e256f00dbbf6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:16.812969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4ce75a4-920f-4f91-ad28-e256f00dbbf6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:16.813399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4ce75a4-920f-4f91-ad28-e256f00dbbf6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:16.939252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b4ce75a4-920f-4f91-ad28-e256f00dbbf6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:16.946745 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b4ce75a4-920f-4f91-ad28-e256f00dbbf6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.145233 Jun 22 11:46:16.947306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 86/151] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:16 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:17.451427 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a8071339-e537-452b-85ac-ddb6ab250a70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:17.452079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a8071339-e537-452b-85ac-ddb6ab250a70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:17.459444 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a8071339-e537-452b-85ac-ddb6ab250a70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:17.459444 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a8071339-e537-452b-85ac-ddb6ab250a70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:17.460087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a8071339-e537-452b-85ac-ddb6ab250a70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:17.460511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a8071339-e537-452b-85ac-ddb6ab250a70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:17.464605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:17.592718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a8071339-e537-452b-85ac-ddb6ab250a70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:17.600106 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a8071339-e537-452b-85ac-ddb6ab250a70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.152484 Jun 22 11:46:17.600666 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 87/152] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:17 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:17.605005 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fa047087-4283-454b-a99f-625a1402a28e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:17.605601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fa047087-4283-454b-a99f-625a1402a28e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:17.611789 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fa047087-4283-454b-a99f-625a1402a28e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:17.612230 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fa047087-4283-454b-a99f-625a1402a28e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:17.612980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fa047087-4283-454b-a99f-625a1402a28e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:17.613406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fa047087-4283-454b-a99f-625a1402a28e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:17.672201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fa047087-4283-454b-a99f-625a1402a28e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:17.680338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fa047087-4283-454b-a99f-625a1402a28e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1209 microversion: 2.1 time: 0.078689 Jun 22 11:46:17.680911 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 88/153] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:17 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:17.964031 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8105f45e-07bd-4e0c-a0d5-2816019c284d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:17.964632 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8105f45e-07bd-4e0c-a0d5-2816019c284d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:17.971238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8105f45e-07bd-4e0c-a0d5-2816019c284d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:17.971709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8105f45e-07bd-4e0c-a0d5-2816019c284d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:17.972457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8105f45e-07bd-4e0c-a0d5-2816019c284d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:17.972883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8105f45e-07bd-4e0c-a0d5-2816019c284d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:18.100917 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8105f45e-07bd-4e0c-a0d5-2816019c284d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:18.108426 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8105f45e-07bd-4e0c-a0d5-2816019c284d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.148234 Jun 22 11:46:18.108982 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 89/154] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:17 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:18.506703 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:18.618161 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4cdc8170-b512-4ba2-a3f7-2678faca39c7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:18.618799 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4cdc8170-b512-4ba2-a3f7-2678faca39c7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:18.621069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:18.622075 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=6 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:18.628931 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4cdc8170-b512-4ba2-a3f7-2678faca39c7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:18.629381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4cdc8170-b512-4ba2-a3f7-2678faca39c7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:18.630149 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4cdc8170-b512-4ba2-a3f7-2678faca39c7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:18.630581 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4cdc8170-b512-4ba2-a3f7-2678faca39c7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:18.769821 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4cdc8170-b512-4ba2-a3f7-2678faca39c7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:18.777316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4cdc8170-b512-4ba2-a3f7-2678faca39c7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1363 microversion: 2.1 time: 0.163769 Jun 22 11:46:18.777875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 90/155] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:18 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:18.783069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3b6fb8fe-27a1-4596-8d5c-8ad4114d3bc5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:18.784223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3b6fb8fe-27a1-4596-8d5c-8ad4114d3bc5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:18.790297 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3b6fb8fe-27a1-4596-8d5c-8ad4114d3bc5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:18.790744 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3b6fb8fe-27a1-4596-8d5c-8ad4114d3bc5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:18.791529 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3b6fb8fe-27a1-4596-8d5c-8ad4114d3bc5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:18.791955 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3b6fb8fe-27a1-4596-8d5c-8ad4114d3bc5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:18.872888 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3b6fb8fe-27a1-4596-8d5c-8ad4114d3bc5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:18.880773 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3b6fb8fe-27a1-4596-8d5c-8ad4114d3bc5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1209 microversion: 2.1 time: 0.101919 Jun 22 11:46:18.881343 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 91/156] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:18 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:19.126932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-987f21d5-d1e3-490c-8f68-0d62b5593ed7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:19.127639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-987f21d5-d1e3-490c-8f68-0d62b5593ed7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:19.134026 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-987f21d5-d1e3-490c-8f68-0d62b5593ed7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:19.134406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-987f21d5-d1e3-490c-8f68-0d62b5593ed7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:19.135337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-987f21d5-d1e3-490c-8f68-0d62b5593ed7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:19.135958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-987f21d5-d1e3-490c-8f68-0d62b5593ed7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:19.293071 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-987f21d5-d1e3-490c-8f68-0d62b5593ed7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:19.300640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-987f21d5-d1e3-490c-8f68-0d62b5593ed7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.178621 Jun 22 11:46:19.301207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 92/157] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:19 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:19.794592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1ffc0841-6134-4d25-9ea8-a1654dad6ab8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:19.795286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1ffc0841-6134-4d25-9ea8-a1654dad6ab8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:19.803334 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1ffc0841-6134-4d25-9ea8-a1654dad6ab8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:19.816914 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1ffc0841-6134-4d25-9ea8-a1654dad6ab8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:19.817851 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1ffc0841-6134-4d25-9ea8-a1654dad6ab8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:19.818299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1ffc0841-6134-4d25-9ea8-a1654dad6ab8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:19.892254 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d3a4cab4-c190-4b78-b9ef-593e126b3126 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "POST /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.439522 Jun 22 11:46:19.892940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 66/158] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 11:46:13 2022] POST /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2/os-volume_attachments => generated 194 bytes in 6442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:46:19.899880 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-11033b70-fb1a-4168-a110-ed64fb63b8cb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:19.901039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-11033b70-fb1a-4168-a110-ed64fb63b8cb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:19.903077 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=72 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:19.910133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11033b70-fb1a-4168-a110-ed64fb63b8cb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:19.910574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11033b70-fb1a-4168-a110-ed64fb63b8cb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:19.911547 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11033b70-fb1a-4168-a110-ed64fb63b8cb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:19.912126 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11033b70-fb1a-4168-a110-ed64fb63b8cb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:20.001904 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-11033b70-fb1a-4168-a110-ed64fb63b8cb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:20.009366 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-11033b70-fb1a-4168-a110-ed64fb63b8cb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1265 microversion: 2.1 time: 0.114274 Jun 22 11:46:20.010030 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 67/159] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:19 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:20.064002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1ffc0841-6134-4d25-9ea8-a1654dad6ab8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:20.072581 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1ffc0841-6134-4d25-9ea8-a1654dad6ab8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1550 microversion: 2.1 time: 0.281958 Jun 22 11:46:20.073150 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 93/160] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:19 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1550 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:20.090676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9cdec993-825a-49a1-8368-501336f67550 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:20.091163 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9cdec993-825a-49a1-8368-501336f67550 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:20.098089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9cdec993-825a-49a1-8368-501336f67550 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:20.098558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9cdec993-825a-49a1-8368-501336f67550 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:20.099267 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9cdec993-825a-49a1-8368-501336f67550 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:20.099828 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9cdec993-825a-49a1-8368-501336f67550 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:20.180607 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9cdec993-825a-49a1-8368-501336f67550 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093887 Jun 22 11:46:20.181549 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 68/161] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 11:46:20 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:46:20.320740 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-366ffd17-046e-43d9-a76c-c87256427dfa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:20.321642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-366ffd17-046e-43d9-a76c-c87256427dfa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:20.332420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-366ffd17-046e-43d9-a76c-c87256427dfa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:20.339680 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-366ffd17-046e-43d9-a76c-c87256427dfa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:20.341466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-366ffd17-046e-43d9-a76c-c87256427dfa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:20.341466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-366ffd17-046e-43d9-a76c-c87256427dfa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:20.870089 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-366ffd17-046e-43d9-a76c-c87256427dfa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:20.878794 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-366ffd17-046e-43d9-a76c-c87256427dfa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.564790 Jun 22 11:46:20.879445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 94/162] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:20 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:21.029776 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e5e19f9b-efc7-4271-a45c-e38b4f3c831b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:21.030791 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e5e19f9b-efc7-4271-a45c-e38b4f3c831b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:21.058976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e5e19f9b-efc7-4271-a45c-e38b4f3c831b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:21.059474 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e5e19f9b-efc7-4271-a45c-e38b4f3c831b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:21.060635 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e5e19f9b-efc7-4271-a45c-e38b4f3c831b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:21.061104 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e5e19f9b-efc7-4271-a45c-e38b4f3c831b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:21.384259 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e5e19f9b-efc7-4271-a45c-e38b4f3c831b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:21.395382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e5e19f9b-efc7-4271-a45c-e38b4f3c831b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1273 microversion: 2.1 time: 0.371512 Jun 22 11:46:21.399900 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 69/163] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:21 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1273 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:21.899278 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-718479f2-dc9f-4316-931b-59e43cecd5a0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:21.900767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-718479f2-dc9f-4316-931b-59e43cecd5a0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:21.908978 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-718479f2-dc9f-4316-931b-59e43cecd5a0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:21.909544 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-718479f2-dc9f-4316-931b-59e43cecd5a0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:21.910432 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-718479f2-dc9f-4316-931b-59e43cecd5a0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:21.911096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-718479f2-dc9f-4316-931b-59e43cecd5a0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:22.365181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-718479f2-dc9f-4316-931b-59e43cecd5a0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:22.385899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-718479f2-dc9f-4316-931b-59e43cecd5a0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.492423 Jun 22 11:46:22.387459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 95/164] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:21 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:22.424147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7a0586cd-68ae-4dac-8a88-837a05bf4ba9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:22.425401 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7a0586cd-68ae-4dac-8a88-837a05bf4ba9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:22.435264 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7a0586cd-68ae-4dac-8a88-837a05bf4ba9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:22.436115 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7a0586cd-68ae-4dac-8a88-837a05bf4ba9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:22.438527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7a0586cd-68ae-4dac-8a88-837a05bf4ba9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:22.439907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7a0586cd-68ae-4dac-8a88-837a05bf4ba9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:23.071886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-73cf11ec-9682-421b-ab0d-2eeca6a82cff req-bd3dba13-66b7-4d65-9ed0-0ed0cf87aa65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6ebc0a-848b-4688-939a-062ccc6dc352", "tag": "f2a96738-75af-44d5-9821-e335309678f0"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:23.085738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-73cf11ec-9682-421b-ab0d-2eeca6a82cff req-bd3dba13-66b7-4d65-9ed0-0ed0cf87aa65 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:23.086296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-73cf11ec-9682-421b-ab0d-2eeca6a82cff req-bd3dba13-66b7-4d65-9ed0-0ed0cf87aa65 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:23.112517 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-73cf11ec-9682-421b-ab0d-2eeca6a82cff req-bd3dba13-66b7-4d65-9ed0-0ed0cf87aa65 service nova] Creating event network-changed:f2a96738-75af-44d5-9821-e335309678f0 for instance af6ebc0a-848b-4688-939a-062ccc6dc352 on hv-cinder-83697 Jun 22 11:46:23.119799 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-73cf11ec-9682-421b-ab0d-2eeca6a82cff req-bd3dba13-66b7-4d65-9ed0-0ed0cf87aa65 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051947 Jun 22 11:46:23.129175 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 96/165] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:46:23.176390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7a0586cd-68ae-4dac-8a88-837a05bf4ba9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:23.185570 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7a0586cd-68ae-4dac-8a88-837a05bf4ba9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.771322 Jun 22 11:46:23.187572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 70/166] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:22 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:23.407070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5c39258d-e626-4b90-b917-567d4723414c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:23.408198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5c39258d-e626-4b90-b917-567d4723414c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:23.419253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5c39258d-e626-4b90-b917-567d4723414c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:23.420159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5c39258d-e626-4b90-b917-567d4723414c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:23.421640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5c39258d-e626-4b90-b917-567d4723414c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:23.422327 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5c39258d-e626-4b90-b917-567d4723414c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:23.802095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5c39258d-e626-4b90-b917-567d4723414c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:23.812465 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5c39258d-e626-4b90-b917-567d4723414c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.411747 Jun 22 11:46:23.813927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 97/167] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:23 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:24.204285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b6ba0111-b765-40a3-9984-a61c76e79689 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:24.204891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b6ba0111-b765-40a3-9984-a61c76e79689 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:24.227677 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6ba0111-b765-40a3-9984-a61c76e79689 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:24.228032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6ba0111-b765-40a3-9984-a61c76e79689 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:24.228815 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6ba0111-b765-40a3-9984-a61c76e79689 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:24.229238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6ba0111-b765-40a3-9984-a61c76e79689 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:24.557891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b6ba0111-b765-40a3-9984-a61c76e79689 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:24.584642 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b6ba0111-b765-40a3-9984-a61c76e79689 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.384217 Jun 22 11:46:24.589170 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 71/168] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:24 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:24.831601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-61693cfb-22b1-47c5-9da6-3edb40e1c41f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:24.833206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-61693cfb-22b1-47c5-9da6-3edb40e1c41f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:24.854342 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-61693cfb-22b1-47c5-9da6-3edb40e1c41f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:24.856274 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-61693cfb-22b1-47c5-9da6-3edb40e1c41f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:24.860490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-61693cfb-22b1-47c5-9da6-3edb40e1c41f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:24.862098 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-61693cfb-22b1-47c5-9da6-3edb40e1c41f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:25.083941 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-10d03713-97c7-4fd1-8349-5713121361e5 req-74ae5fe5-2de8-4b71-8c99-30727e2b51df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6559025b-55fc-4312-b71d-77108f3d3aaf", "tag": "a0d7f857-7417-4d6c-af08-56af485787f1"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:25.112042 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-10d03713-97c7-4fd1-8349-5713121361e5 req-74ae5fe5-2de8-4b71-8c99-30727e2b51df service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:25.113409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-10d03713-97c7-4fd1-8349-5713121361e5 req-74ae5fe5-2de8-4b71-8c99-30727e2b51df service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:25.128586 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-10d03713-97c7-4fd1-8349-5713121361e5 req-74ae5fe5-2de8-4b71-8c99-30727e2b51df service nova] Creating event network-changed:a0d7f857-7417-4d6c-af08-56af485787f1 for instance 6559025b-55fc-4312-b71d-77108f3d3aaf on hv-cinder-83697 Jun 22 11:46:25.149351 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-10d03713-97c7-4fd1-8349-5713121361e5 req-74ae5fe5-2de8-4b71-8c99-30727e2b51df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071999 Jun 22 11:46:25.150714 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 72/169] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:46:25.285464 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-61693cfb-22b1-47c5-9da6-3edb40e1c41f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:25.295960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-61693cfb-22b1-47c5-9da6-3edb40e1c41f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.469490 Jun 22 11:46:25.297812 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 98/170] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:24 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:25.617036 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-25e52d72-6fa8-48eb-b570-c372b16ae4eb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:25.620373 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-25e52d72-6fa8-48eb-b570-c372b16ae4eb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:25.654343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25e52d72-6fa8-48eb-b570-c372b16ae4eb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:25.655225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25e52d72-6fa8-48eb-b570-c372b16ae4eb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:25.657893 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25e52d72-6fa8-48eb-b570-c372b16ae4eb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:25.659609 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25e52d72-6fa8-48eb-b570-c372b16ae4eb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:26.002798 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-25e52d72-6fa8-48eb-b570-c372b16ae4eb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:26.018778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-25e52d72-6fa8-48eb-b570-c372b16ae4eb tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.414704 Jun 22 11:46:26.019878 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 73/171] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:25 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:26.322001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-690dc2b6-f1a6-4979-bb7f-7b993f9ac5cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:26.323335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-690dc2b6-f1a6-4979-bb7f-7b993f9ac5cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:26.337095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-690dc2b6-f1a6-4979-bb7f-7b993f9ac5cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:26.337676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-690dc2b6-f1a6-4979-bb7f-7b993f9ac5cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:26.338862 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-690dc2b6-f1a6-4979-bb7f-7b993f9ac5cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:26.339458 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-690dc2b6-f1a6-4979-bb7f-7b993f9ac5cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:26.543524 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-690dc2b6-f1a6-4979-bb7f-7b993f9ac5cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:26.552779 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-690dc2b6-f1a6-4979-bb7f-7b993f9ac5cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.234492 Jun 22 11:46:26.553705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 99/172] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:26 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:27.036977 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4dfbd848-5896-417f-916d-14fcea806ccf tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:27.037583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4dfbd848-5896-417f-916d-14fcea806ccf tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:27.049138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4dfbd848-5896-417f-916d-14fcea806ccf tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:27.049138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4dfbd848-5896-417f-916d-14fcea806ccf tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:27.049138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4dfbd848-5896-417f-916d-14fcea806ccf tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:27.049138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4dfbd848-5896-417f-916d-14fcea806ccf tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:27.235460 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4dfbd848-5896-417f-916d-14fcea806ccf tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:27.243601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4dfbd848-5896-417f-916d-14fcea806ccf tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.210533 Jun 22 11:46:27.245340 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 74/173] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:27 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:27.580963 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d363a21a-195b-4190-9794-feaa9b8e11ba tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:27.582172 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d363a21a-195b-4190-9794-feaa9b8e11ba tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:27.593053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d363a21a-195b-4190-9794-feaa9b8e11ba tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:27.593693 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d363a21a-195b-4190-9794-feaa9b8e11ba tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:27.594872 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d363a21a-195b-4190-9794-feaa9b8e11ba tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:27.595514 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d363a21a-195b-4190-9794-feaa9b8e11ba tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:27.836827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d363a21a-195b-4190-9794-feaa9b8e11ba tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:27.847013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d363a21a-195b-4190-9794-feaa9b8e11ba tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.274794 Jun 22 11:46:27.847895 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 100/174] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:27 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:28.266800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a97a52ba-f20a-4696-9e92-64cbb5caec02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:28.268416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a97a52ba-f20a-4696-9e92-64cbb5caec02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:28.275694 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a97a52ba-f20a-4696-9e92-64cbb5caec02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:28.276128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a97a52ba-f20a-4696-9e92-64cbb5caec02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:28.276961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a97a52ba-f20a-4696-9e92-64cbb5caec02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:28.277514 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a97a52ba-f20a-4696-9e92-64cbb5caec02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:28.480828 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a97a52ba-f20a-4696-9e92-64cbb5caec02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:28.489519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a97a52ba-f20a-4696-9e92-64cbb5caec02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.228241 Jun 22 11:46:28.490350 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 75/175] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:28 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:28.884128 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ec04dd0f-0c89-4ed1-95ea-8dda7fa1e0ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:28.885417 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ec04dd0f-0c89-4ed1-95ea-8dda7fa1e0ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:28.918385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec04dd0f-0c89-4ed1-95ea-8dda7fa1e0ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:28.919177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec04dd0f-0c89-4ed1-95ea-8dda7fa1e0ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:28.920598 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec04dd0f-0c89-4ed1-95ea-8dda7fa1e0ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:28.921370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec04dd0f-0c89-4ed1-95ea-8dda7fa1e0ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:29.240656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ec04dd0f-0c89-4ed1-95ea-8dda7fa1e0ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:29.253246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ec04dd0f-0c89-4ed1-95ea-8dda7fa1e0ac tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.390115 Jun 22 11:46:29.263203 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 101/176] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:28 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:29.510009 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3fd26b5f-4c9b-49c9-a8b1-afa4cb4fb400 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:29.510602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3fd26b5f-4c9b-49c9-a8b1-afa4cb4fb400 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:29.518726 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3fd26b5f-4c9b-49c9-a8b1-afa4cb4fb400 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:29.519173 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3fd26b5f-4c9b-49c9-a8b1-afa4cb4fb400 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:29.520023 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3fd26b5f-4c9b-49c9-a8b1-afa4cb4fb400 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:29.520428 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3fd26b5f-4c9b-49c9-a8b1-afa4cb4fb400 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:29.541769 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:29.722210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3fd26b5f-4c9b-49c9-a8b1-afa4cb4fb400 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:29.731819 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3fd26b5f-4c9b-49c9-a8b1-afa4cb4fb400 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.225531 Jun 22 11:46:29.732502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 76/177] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:29 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:30.272466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-09f9bbfd-5dd6-4112-82c1-76b6ce14ed65 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:30.273214 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-09f9bbfd-5dd6-4112-82c1-76b6ce14ed65 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:30.280333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-09f9bbfd-5dd6-4112-82c1-76b6ce14ed65 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:30.280899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-09f9bbfd-5dd6-4112-82c1-76b6ce14ed65 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:30.281783 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-09f9bbfd-5dd6-4112-82c1-76b6ce14ed65 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:30.282427 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-09f9bbfd-5dd6-4112-82c1-76b6ce14ed65 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:30.603578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-09f9bbfd-5dd6-4112-82c1-76b6ce14ed65 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:30.614998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-09f9bbfd-5dd6-4112-82c1-76b6ce14ed65 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.346949 Jun 22 11:46:30.615621 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 102/178] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:30 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:30.751139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a5a64fb5-db16-4171-83ca-9f94f60cf3b0 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:30.751864 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a5a64fb5-db16-4171-83ca-9f94f60cf3b0 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:30.761644 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a5a64fb5-db16-4171-83ca-9f94f60cf3b0 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:30.762119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a5a64fb5-db16-4171-83ca-9f94f60cf3b0 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:30.762926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a5a64fb5-db16-4171-83ca-9f94f60cf3b0 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:30.764892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a5a64fb5-db16-4171-83ca-9f94f60cf3b0 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:31.051062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a5a64fb5-db16-4171-83ca-9f94f60cf3b0 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:31.072152 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a5a64fb5-db16-4171-83ca-9f94f60cf3b0 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.325152 Jun 22 11:46:31.073226 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 77/179] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:30 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:31.638734 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ed3fc5f7-aa60-49d4-a323-32399d562e1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:31.641515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ed3fc5f7-aa60-49d4-a323-32399d562e1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:31.657706 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ed3fc5f7-aa60-49d4-a323-32399d562e1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:31.658167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ed3fc5f7-aa60-49d4-a323-32399d562e1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:31.661354 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ed3fc5f7-aa60-49d4-a323-32399d562e1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:31.667434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ed3fc5f7-aa60-49d4-a323-32399d562e1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:32.000594 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ed3fc5f7-aa60-49d4-a323-32399d562e1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:32.012798 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ed3fc5f7-aa60-49d4-a323-32399d562e1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.382650 Jun 22 11:46:32.026041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 103/180] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:31 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:32.099605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-df06da65-3e44-43ef-8f57-bf6e42768f1d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:32.101481 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-df06da65-3e44-43ef-8f57-bf6e42768f1d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:32.117250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df06da65-3e44-43ef-8f57-bf6e42768f1d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:32.121013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df06da65-3e44-43ef-8f57-bf6e42768f1d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:32.122708 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df06da65-3e44-43ef-8f57-bf6e42768f1d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:32.127401 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df06da65-3e44-43ef-8f57-bf6e42768f1d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:32.456256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-df06da65-3e44-43ef-8f57-bf6e42768f1d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:32.470863 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-df06da65-3e44-43ef-8f57-bf6e42768f1d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.375660 Jun 22 11:46:32.472078 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 78/181] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:32 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:32.836201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a3a950ac-3e1d-4eec-9cbe-7dfafb2676e0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:32.837758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a3a950ac-3e1d-4eec-9cbe-7dfafb2676e0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:32.848925 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a3a950ac-3e1d-4eec-9cbe-7dfafb2676e0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:32.849622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a3a950ac-3e1d-4eec-9cbe-7dfafb2676e0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:32.851412 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a3a950ac-3e1d-4eec-9cbe-7dfafb2676e0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:32.852070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a3a950ac-3e1d-4eec-9cbe-7dfafb2676e0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:32.904935 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:32.977923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a3a950ac-3e1d-4eec-9cbe-7dfafb2676e0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:46:33.030960 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ed0cf33d-a5e0-4bb6-b1e2-776435f0bc99 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:33.032296 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ed0cf33d-a5e0-4bb6-b1e2-776435f0bc99 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:33.051973 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ed0cf33d-a5e0-4bb6-b1e2-776435f0bc99 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:33.054252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ed0cf33d-a5e0-4bb6-b1e2-776435f0bc99 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:33.062860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ed0cf33d-a5e0-4bb6-b1e2-776435f0bc99 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:33.064326 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ed0cf33d-a5e0-4bb6-b1e2-776435f0bc99 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:33.323529 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a3a950ac-3e1d-4eec-9cbe-7dfafb2676e0 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 204 len: 0 microversion: 2.1 time: 0.493837 Jun 22 11:46:33.327062 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 104/182] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:46:32 2022] DELETE /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:46:33.342519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cd856dc5-406e-479c-887d-965d3dcca111 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:33.344988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cd856dc5-406e-479c-887d-965d3dcca111 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:33.361065 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cd856dc5-406e-479c-887d-965d3dcca111 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:33.362776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cd856dc5-406e-479c-887d-965d3dcca111 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:33.363672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cd856dc5-406e-479c-887d-965d3dcca111 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:33.364129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cd856dc5-406e-479c-887d-965d3dcca111 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:33.521618 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ed0cf33d-a5e0-4bb6-b1e2-776435f0bc99 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:33.534755 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ed0cf33d-a5e0-4bb6-b1e2-776435f0bc99 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.507768 Jun 22 11:46:33.536153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 79/183] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:33 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:33.554829 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-d29b0e1e-cd12-4aff-b4b8-2da3d52be0e7 req-40f0c598-b400-4855-8804-70a16ad7b744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6559025b-55fc-4312-b71d-77108f3d3aaf", "name": "network-vif-plugged", "status": "completed", "tag": "a0d7f857-7417-4d6c-af08-56af485787f1"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:33.574753 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-d29b0e1e-cd12-4aff-b4b8-2da3d52be0e7 req-40f0c598-b400-4855-8804-70a16ad7b744 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:33.575435 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-d29b0e1e-cd12-4aff-b4b8-2da3d52be0e7 req-40f0c598-b400-4855-8804-70a16ad7b744 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:33.595526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-d29b0e1e-cd12-4aff-b4b8-2da3d52be0e7 req-40f0c598-b400-4855-8804-70a16ad7b744 service nova] Creating event network-vif-plugged:a0d7f857-7417-4d6c-af08-56af485787f1 for instance 6559025b-55fc-4312-b71d-77108f3d3aaf on hv-cinder-83697 Jun 22 11:46:33.603371 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-d29b0e1e-cd12-4aff-b4b8-2da3d52be0e7 req-40f0c598-b400-4855-8804-70a16ad7b744 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065220 Jun 22 11:46:33.607936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 80/184] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:46:33.623934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-aa70b084-cfae-41a1-9bbb-4b6bb3fba959 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:33.624653 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-aa70b084-cfae-41a1-9bbb-4b6bb3fba959 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:33.644277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa70b084-cfae-41a1-9bbb-4b6bb3fba959 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:33.644718 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa70b084-cfae-41a1-9bbb-4b6bb3fba959 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:33.645913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa70b084-cfae-41a1-9bbb-4b6bb3fba959 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:33.646696 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa70b084-cfae-41a1-9bbb-4b6bb3fba959 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:33.669403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cd856dc5-406e-479c-887d-965d3dcca111 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:33.679815 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cd856dc5-406e-479c-887d-965d3dcca111 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1555 microversion: 2.1 time: 0.348055 Jun 22 11:46:33.680396 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 105/185] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:33 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1555 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:33.853504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-aa70b084-cfae-41a1-9bbb-4b6bb3fba959 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:33.862526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-aa70b084-cfae-41a1-9bbb-4b6bb3fba959 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.253212 Jun 22 11:46:33.873017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 81/186] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:33 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:34.552113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b9a83dad-b2ec-4021-9860-865208c4fcef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:34.552717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b9a83dad-b2ec-4021-9860-865208c4fcef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:34.566191 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b9a83dad-b2ec-4021-9860-865208c4fcef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:34.566634 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b9a83dad-b2ec-4021-9860-865208c4fcef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:34.567420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b9a83dad-b2ec-4021-9860-865208c4fcef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:34.568968 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b9a83dad-b2ec-4021-9860-865208c4fcef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:34.700136 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a050408c-4e7c-45f1-9530-4a7c0acf2be8 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:34.701609 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a050408c-4e7c-45f1-9530-4a7c0acf2be8 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:34.725138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a050408c-4e7c-45f1-9530-4a7c0acf2be8 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:34.727522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a050408c-4e7c-45f1-9530-4a7c0acf2be8 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:34.728535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a050408c-4e7c-45f1-9530-4a7c0acf2be8 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:34.729619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a050408c-4e7c-45f1-9530-4a7c0acf2be8 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:34.781591 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b9a83dad-b2ec-4021-9860-865208c4fcef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:34.790947 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b9a83dad-b2ec-4021-9860-865208c4fcef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.242909 Jun 22 11:46:34.791955 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 106/187] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:34 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:34.880723 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fc14532f-8b2f-4c52-8efd-202dfe79378b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:34.881726 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fc14532f-8b2f-4c52-8efd-202dfe79378b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:34.890770 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:34.898201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fc14532f-8b2f-4c52-8efd-202dfe79378b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:34.899606 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fc14532f-8b2f-4c52-8efd-202dfe79378b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:34.903002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fc14532f-8b2f-4c52-8efd-202dfe79378b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:34.905152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fc14532f-8b2f-4c52-8efd-202dfe79378b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:34.935243 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a050408c-4e7c-45f1-9530-4a7c0acf2be8 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:34.954055 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a050408c-4e7c-45f1-9530-4a7c0acf2be8 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1555 microversion: 2.1 time: 0.258414 Jun 22 11:46:34.954657 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 82/188] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:34 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:35.179069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fc14532f-8b2f-4c52-8efd-202dfe79378b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:35.193838 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fc14532f-8b2f-4c52-8efd-202dfe79378b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.316079 Jun 22 11:46:35.194444 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 107/189] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:34 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:35.733355 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-202560765", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:35.791841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] validate_networks() for None {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:46:35.809146 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f28d853c-96f5-481d-bee5-8849d05f2392 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:35.809853 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f28d853c-96f5-481d-bee5-8849d05f2392 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:35.818276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f28d853c-96f5-481d-bee5-8849d05f2392 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:35.818818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f28d853c-96f5-481d-bee5-8849d05f2392 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:35.819705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f28d853c-96f5-481d-bee5-8849d05f2392 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:35.820197 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f28d853c-96f5-481d-bee5-8849d05f2392 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:36.149837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f28d853c-96f5-481d-bee5-8849d05f2392 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:36.158387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f28d853c-96f5-481d-bee5-8849d05f2392 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.353354 Jun 22 11:46:36.159225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 108/190] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:35 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:36.164278 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1a7d235f-efac-4e1d-b2e8-0084b153da44 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:36.165151 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1a7d235f-efac-4e1d-b2e8-0084b153da44 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:36.171712 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a7d235f-efac-4e1d-b2e8-0084b153da44 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:36.173023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a7d235f-efac-4e1d-b2e8-0084b153da44 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:36.173990 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a7d235f-efac-4e1d-b2e8-0084b153da44 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:36.174577 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a7d235f-efac-4e1d-b2e8-0084b153da44 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:36.193421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:46:36.193833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:46:36.194297 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:46:36.194696 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:46:36.195093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:46:36.206901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:36.207639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:36.208713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:36.209493 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:36.230136 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Getting quotas for project 4829f904e10c4df197b253f1211157af. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:46:36.235107 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Getting quotas for user 6cd3a653cb514e37bad8080d8a5cc7b0 and project 4829f904e10c4df197b253f1211157af. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:46:36.247276 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:46:36.249805 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:46:36.311943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-66827b29-ac61-423d-8f98-51120fc8101f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581568 Jun 22 11:46:36.313001 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 83/191] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:46:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 11:46:36.328902 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5899eb59-0143-43ac-af2e-8d8f08a8853a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:36.330629 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5899eb59-0143-43ac-af2e-8d8f08a8853a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:36.338728 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5899eb59-0143-43ac-af2e-8d8f08a8853a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:36.339698 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5899eb59-0143-43ac-af2e-8d8f08a8853a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:36.340928 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5899eb59-0143-43ac-af2e-8d8f08a8853a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:36.341523 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5899eb59-0143-43ac-af2e-8d8f08a8853a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:36.357907 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1a7d235f-efac-4e1d-b2e8-0084b153da44 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:36.368695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1a7d235f-efac-4e1d-b2e8-0084b153da44 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1555 microversion: 2.1 time: 0.208218 Jun 22 11:46:36.369673 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 109/192] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:36 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:36.374393 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-06b7d7db-5626-448f-ad9f-02dbd31b5725 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:36.375038 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-06b7d7db-5626-448f-ad9f-02dbd31b5725 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:36.441295 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-06b7d7db-5626-448f-ad9f-02dbd31b5725 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:36.448787 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-06b7d7db-5626-448f-ad9f-02dbd31b5725 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1214 microversion: 2.1 time: 0.077934 Jun 22 11:46:36.459058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 110/193] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:36 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:36.596474 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5899eb59-0143-43ac-af2e-8d8f08a8853a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:36.603986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5899eb59-0143-43ac-af2e-8d8f08a8853a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.285343 Jun 22 11:46:36.612854 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 84/194] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:36 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:37.179436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-28051ddc-2982-4b42-9ccf-5da3f8c2110f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:37.180571 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-28051ddc-2982-4b42-9ccf-5da3f8c2110f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:37.188111 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-28051ddc-2982-4b42-9ccf-5da3f8c2110f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:37.188556 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-28051ddc-2982-4b42-9ccf-5da3f8c2110f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:37.189313 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-28051ddc-2982-4b42-9ccf-5da3f8c2110f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:37.189889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-28051ddc-2982-4b42-9ccf-5da3f8c2110f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:37.387892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-75cb502c-7a05-4089-af6d-73bc5dcfbc4a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:37.390627 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-75cb502c-7a05-4089-af6d-73bc5dcfbc4a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:37.390868 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-28051ddc-2982-4b42-9ccf-5da3f8c2110f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:37.401866 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-28051ddc-2982-4b42-9ccf-5da3f8c2110f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.228788 Jun 22 11:46:37.404768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-75cb502c-7a05-4089-af6d-73bc5dcfbc4a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:37.405059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-75cb502c-7a05-4089-af6d-73bc5dcfbc4a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:37.405828 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-75cb502c-7a05-4089-af6d-73bc5dcfbc4a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:37.406366 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-75cb502c-7a05-4089-af6d-73bc5dcfbc4a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:37.423093 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 111/195] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:37 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:37.471596 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-58e75323-1ecd-44da-a8ab-f1598edb39db tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:37.475401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-58e75323-1ecd-44da-a8ab-f1598edb39db tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:37.493476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58e75323-1ecd-44da-a8ab-f1598edb39db tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:37.494236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58e75323-1ecd-44da-a8ab-f1598edb39db tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:37.495792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58e75323-1ecd-44da-a8ab-f1598edb39db tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:37.496774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58e75323-1ecd-44da-a8ab-f1598edb39db tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:37.748629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-58e75323-1ecd-44da-a8ab-f1598edb39db tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:37.789834 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-58e75323-1ecd-44da-a8ab-f1598edb39db tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1210 microversion: 2.1 time: 0.325553 Jun 22 11:46:37.790913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-75cb502c-7a05-4089-af6d-73bc5dcfbc4a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:37.824727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 112/196] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:37 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1210 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:37.826200 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-75cb502c-7a05-4089-af6d-73bc5dcfbc4a tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1555 microversion: 2.1 time: 0.441965 Jun 22 11:46:37.846003 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 85/197] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:37 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1555 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:37.855045 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-066f5622-bf41-4fa4-a42e-975b1553d352 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:37.877522 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-066f5622-bf41-4fa4-a42e-975b1553d352 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:37.894730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-066f5622-bf41-4fa4-a42e-975b1553d352 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:37.900127 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-066f5622-bf41-4fa4-a42e-975b1553d352 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:37.901246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-066f5622-bf41-4fa4-a42e-975b1553d352 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:37.901854 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-066f5622-bf41-4fa4-a42e-975b1553d352 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:38.140385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-066f5622-bf41-4fa4-a42e-975b1553d352 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:38.159475 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-066f5622-bf41-4fa4-a42e-975b1553d352 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1313 microversion: 2.1 time: 0.332778 Jun 22 11:46:38.161265 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 113/198] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:37 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:38.437172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b0761e26-be79-46fc-a4e8-a296e4dd0009 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:38.439199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b0761e26-be79-46fc-a4e8-a296e4dd0009 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:38.452563 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b0761e26-be79-46fc-a4e8-a296e4dd0009 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:38.453343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b0761e26-be79-46fc-a4e8-a296e4dd0009 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:38.455155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b0761e26-be79-46fc-a4e8-a296e4dd0009 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:38.456380 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b0761e26-be79-46fc-a4e8-a296e4dd0009 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:38.598901 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-c20abead-36e5-4478-9226-de49daa1cc74 req-f2485784-c721-4f79-af52-4c543bbf286c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf84814-c021-401e-90d4-3b71f83a14a2", "name": "network-vif-deleted", "tag": "f98ebffe-f0f3-42f3-b0e7-858c2b11ea46"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:38.615735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-c20abead-36e5-4478-9226-de49daa1cc74 req-f2485784-c721-4f79-af52-4c543bbf286c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:38.616299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-c20abead-36e5-4478-9226-de49daa1cc74 req-f2485784-c721-4f79-af52-4c543bbf286c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:38.637014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-c20abead-36e5-4478-9226-de49daa1cc74 req-f2485784-c721-4f79-af52-4c543bbf286c service nova] Creating event network-vif-deleted:f98ebffe-f0f3-42f3-b0e7-858c2b11ea46 for instance 0bf84814-c021-401e-90d4-3b71f83a14a2 on hv-cinder-83697 Jun 22 11:46:38.644834 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-c20abead-36e5-4478-9226-de49daa1cc74 req-f2485784-c721-4f79-af52-4c543bbf286c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053041 Jun 22 11:46:38.646160 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 114/199] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:46:38.695479 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b0761e26-be79-46fc-a4e8-a296e4dd0009 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:38.707585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b0761e26-be79-46fc-a4e8-a296e4dd0009 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.278272 Jun 22 11:46:38.708423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 86/200] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:38 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:38.823511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-58bd3123-6da6-46d3-b321-df8ef197cb99 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:38.824341 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-58bd3123-6da6-46d3-b321-df8ef197cb99 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:38.835275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58bd3123-6da6-46d3-b321-df8ef197cb99 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:38.835896 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58bd3123-6da6-46d3-b321-df8ef197cb99 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:38.837028 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58bd3123-6da6-46d3-b321-df8ef197cb99 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:38.837553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58bd3123-6da6-46d3-b321-df8ef197cb99 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:38.862350 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2d7332b1-4dde-45f2-b673-2bdcd9a6d7b1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:38.862977 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2d7332b1-4dde-45f2-b673-2bdcd9a6d7b1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:38.870117 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d7332b1-4dde-45f2-b673-2bdcd9a6d7b1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:38.870548 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d7332b1-4dde-45f2-b673-2bdcd9a6d7b1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:38.871330 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d7332b1-4dde-45f2-b673-2bdcd9a6d7b1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:38.871983 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d7332b1-4dde-45f2-b673-2bdcd9a6d7b1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:38.964225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-58bd3123-6da6-46d3-b321-df8ef197cb99 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:38.974998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-58bd3123-6da6-46d3-b321-df8ef197cb99 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1266 microversion: 2.1 time: 0.157621 Jun 22 11:46:38.975655 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 115/201] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:38 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:38.998513 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2d7332b1-4dde-45f2-b673-2bdcd9a6d7b1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:39.021471 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2d7332b1-4dde-45f2-b673-2bdcd9a6d7b1 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1346 microversion: 2.1 time: 0.162990 Jun 22 11:46:39.022075 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 87/202] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:38 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:39.181579 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e21ca47d-dacd-4a09-b42b-20975e08d194 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:39.184730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e21ca47d-dacd-4a09-b42b-20975e08d194 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:39.191960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e21ca47d-dacd-4a09-b42b-20975e08d194 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:39.192590 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e21ca47d-dacd-4a09-b42b-20975e08d194 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:39.193763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e21ca47d-dacd-4a09-b42b-20975e08d194 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:39.194269 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e21ca47d-dacd-4a09-b42b-20975e08d194 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:39.394132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e21ca47d-dacd-4a09-b42b-20975e08d194 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:39.404336 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e21ca47d-dacd-4a09-b42b-20975e08d194 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1496 microversion: 2.1 time: 0.229325 Jun 22 11:46:39.405558 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 116/203] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:39 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1496 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:39.731867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8414f8af-0d17-4c53-92b5-a5f1691dba8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:39.733301 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8414f8af-0d17-4c53-92b5-a5f1691dba8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:39.748526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8414f8af-0d17-4c53-92b5-a5f1691dba8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:39.749587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8414f8af-0d17-4c53-92b5-a5f1691dba8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:39.752182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8414f8af-0d17-4c53-92b5-a5f1691dba8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:39.752976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8414f8af-0d17-4c53-92b5-a5f1691dba8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.000437 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8414f8af-0d17-4c53-92b5-a5f1691dba8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:40.004873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-df2d2131-af7e-4adf-9ca2-ff23c08cbf16 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:40.008648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-df2d2131-af7e-4adf-9ca2-ff23c08cbf16 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:40.023421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8414f8af-0d17-4c53-92b5-a5f1691dba8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.299985 Jun 22 11:46:40.029414 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 88/204] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:39 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:40.051708 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:40.053465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:40.066970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-df2d2131-af7e-4adf-9ca2-ff23c08cbf16 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.069069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-df2d2131-af7e-4adf-9ca2-ff23c08cbf16 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.070673 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-df2d2131-af7e-4adf-9ca2-ff23c08cbf16 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.071679 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-df2d2131-af7e-4adf-9ca2-ff23c08cbf16 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.075293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.075977 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.080490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.083041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.143113 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.144172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.145086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lazy-loading 'fault' on Instance uuid 0bf84814-c021-401e-90d4-3b71f83a14a2 {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:46:40.205443 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-df2d2131-af7e-4adf-9ca2-ff23c08cbf16 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:40.218402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-df2d2131-af7e-4adf-9ca2-ff23c08cbf16 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1272 microversion: 2.1 time: 0.221646 Jun 22 11:46:40.223769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 117/205] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:39 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:40.247616 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a3e35ce254868bf3825cf60139979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35df61dc9f3544a4ad9fa3be324d1e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:40.254902 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-77c75fb5-3105-4b50-920c-81d955c6eb25 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:40.257892 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-77c75fb5-3105-4b50-920c-81d955c6eb25 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:40.270789 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-77c75fb5-3105-4b50-920c-81d955c6eb25 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.271699 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-77c75fb5-3105-4b50-920c-81d955c6eb25 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.272836 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-77c75fb5-3105-4b50-920c-81d955c6eb25 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.274237 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-77c75fb5-3105-4b50-920c-81d955c6eb25 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.278012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8b1492d4-bc00-4056-af32-b1bbcf0635f5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 200 len: 1351 microversion: 2.1 time: 0.232639 Jun 22 11:46:40.282960 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 89/206] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:40 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 1351 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:40.320028 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-77c75fb5-3105-4b50-920c-81d955c6eb25 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:46:40.463443 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-77c75fb5-3105-4b50-920c-81d955c6eb25 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 204 len: 0 microversion: 2.1 time: 0.212749 Jun 22 11:46:40.464717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 118/207] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:46:40 2022] DELETE /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:46:40.483604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fe1744fd-ad89-428f-b99d-efa86f2cba55 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:40.483604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-fe1744fd-ad89-428f-b99d-efa86f2cba55 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:40.503648 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fe1744fd-ad89-428f-b99d-efa86f2cba55 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.504260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fe1744fd-ad89-428f-b99d-efa86f2cba55 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.505675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fe1744fd-ad89-428f-b99d-efa86f2cba55 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:40.506433 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fe1744fd-ad89-428f-b99d-efa86f2cba55 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:40.741704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fe1744fd-ad89-428f-b99d-efa86f2cba55 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:40.770361 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-fe1744fd-ad89-428f-b99d-efa86f2cba55 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1502 microversion: 2.1 time: 0.298832 Jun 22 11:46:40.800996 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 90/208] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:40 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1502 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:41.058369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cc347669-aa02-46a6-bf45-ee97aa8e8dd8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:41.059556 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cc347669-aa02-46a6-bf45-ee97aa8e8dd8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:41.069101 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc347669-aa02-46a6-bf45-ee97aa8e8dd8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.069836 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc347669-aa02-46a6-bf45-ee97aa8e8dd8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.071050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc347669-aa02-46a6-bf45-ee97aa8e8dd8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.071796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc347669-aa02-46a6-bf45-ee97aa8e8dd8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.103706 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:41.244432 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0abbc90e-1bd4-4aa3-9547-830cb994334d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:41.245620 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0abbc90e-1bd4-4aa3-9547-830cb994334d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:41.254359 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0abbc90e-1bd4-4aa3-9547-830cb994334d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.254918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0abbc90e-1bd4-4aa3-9547-830cb994334d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.256183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0abbc90e-1bd4-4aa3-9547-830cb994334d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.256838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0abbc90e-1bd4-4aa3-9547-830cb994334d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.261864 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cc347669-aa02-46a6-bf45-ee97aa8e8dd8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:41.270837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cc347669-aa02-46a6-bf45-ee97aa8e8dd8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.218857 Jun 22 11:46:41.271549 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 119/209] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:41 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:41.307579 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:41.308989 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:41.315538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.316127 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.316984 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.317636 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.332681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] HTTP exception thrown: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Request method failure captured: Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 HTTP/1.1 Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDKRAawKx2WAfoTOjfcLGMikSBcMWr_tO3zwayaAibbYaSThdIN19iO_fPiNrzQYPWT1ZR_8aGn2UA9OCKAWZ_R7s8aDnEomFHPOQRPtuwBd_bnvHDuUsyjVmKZks8S8_hlaXusSujre9j8Jl42_btYK1e97EZYEKEq55t1746B2-k Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 35df61dc9f3544a4ad9fa3be324d1e8b Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:46:41.337645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35df61dc9f3544a4ad9fa3be324d1e8b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 35df61dc9f3544a4ad9fa3be324d1e8b Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-DeleteServersTestJSON-1230262323-project Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 3b8a3e35ce254868bf3825cf60139979 Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-DeleteServersTestJSON-1230262323-project Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.338930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '0bf84814-c021-401e-90d4-3b71f83a14a2'} Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:46:41.339760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.340950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.343881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Returning 404 to user: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:46:41.345291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b2d41646-7f5d-49a3-8f7d-a77700523507 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 404 len: 111 microversion: 2.1 time: 0.040986 Jun 22 11:46:41.346053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 120/210] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:41 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 11:46:41.460164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0abbc90e-1bd4-4aa3-9547-830cb994334d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:41.469467 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0abbc90e-1bd4-4aa3-9547-830cb994334d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.231625 Jun 22 11:46:41.470318 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 91/211] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:41 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:41.530651 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:41.531749 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:41.538712 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.539189 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.540003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.540587 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.556741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] HTTP exception thrown: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Request method failure captured: Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2/os-volume_attachments HTTP/1.1 Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDKRAawKx2WAfoTOjfcLGMikSBcMWr_tO3zwayaAibbYaSThdIN19iO_fPiNrzQYPWT1ZR_8aGn2UA9OCKAWZ_R7s8aDnEomFHPOQRPtuwBd_bnvHDuUsyjVmKZks8S8_hlaXusSujre9j8Jl42_btYK1e97EZYEKEq55t1746B2-k Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 35df61dc9f3544a4ad9fa3be324d1e8b Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:46:41.558871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35df61dc9f3544a4ad9fa3be324d1e8b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 35df61dc9f3544a4ad9fa3be324d1e8b Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-DeleteServersTestJSON-1230262323-project Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 3b8a3e35ce254868bf3825cf60139979 Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-DeleteServersTestJSON-1230262323-project Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.560192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'server_id': '0bf84814-c021-401e-90d4-3b71f83a14a2'} Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:46:41.560873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:41.561936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:41.563678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Returning 404 to user: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:46:41.563678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cf21a18b-a558-4e82-add5-8cd06672fad5 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034468 Jun 22 11:46:41.569124 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 121/212] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:46:41 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:46:41.799498 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-00935f25-7681-4f9a-adf8-a92c64298f02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:41.800579 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-00935f25-7681-4f9a-adf8-a92c64298f02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:41.814450 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00935f25-7681-4f9a-adf8-a92c64298f02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.814892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00935f25-7681-4f9a-adf8-a92c64298f02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.815725 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00935f25-7681-4f9a-adf8-a92c64298f02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:41.816150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00935f25-7681-4f9a-adf8-a92c64298f02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:41.971583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-00935f25-7681-4f9a-adf8-a92c64298f02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:41.983749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-00935f25-7681-4f9a-adf8-a92c64298f02 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1502 microversion: 2.1 time: 0.191273 Jun 22 11:46:41.984889 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 92/213] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:41 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:42.293013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c14ce0a9-89b8-4ff8-b30f-d07302c42360 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:42.293821 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c14ce0a9-89b8-4ff8-b30f-d07302c42360 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:42.301005 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c14ce0a9-89b8-4ff8-b30f-d07302c42360 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:42.301520 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c14ce0a9-89b8-4ff8-b30f-d07302c42360 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:42.302349 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c14ce0a9-89b8-4ff8-b30f-d07302c42360 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:42.302840 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c14ce0a9-89b8-4ff8-b30f-d07302c42360 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:42.487771 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1e6f0fd9-716c-40b9-9fbf-7c15b026c96a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:42.488329 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1e6f0fd9-716c-40b9-9fbf-7c15b026c96a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:42.494807 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e6f0fd9-716c-40b9-9fbf-7c15b026c96a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:42.495239 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e6f0fd9-716c-40b9-9fbf-7c15b026c96a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:42.496201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e6f0fd9-716c-40b9-9fbf-7c15b026c96a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:42.496783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e6f0fd9-716c-40b9-9fbf-7c15b026c96a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:42.523746 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c14ce0a9-89b8-4ff8-b30f-d07302c42360 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:42.538814 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c14ce0a9-89b8-4ff8-b30f-d07302c42360 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.252277 Jun 22 11:46:42.540298 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 122/214] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:42 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:42.748444 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1e6f0fd9-716c-40b9-9fbf-7c15b026c96a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:42.766593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1e6f0fd9-716c-40b9-9fbf-7c15b026c96a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.282982 Jun 22 11:46:42.769716 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 93/215] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:42 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:42.830723 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:42.831220 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:42.838759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:42.839401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:42.841240 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:42.842029 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:42.886095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] HTTP exception thrown: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Request method failure captured: Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: DELETE /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 HTTP/1.1 Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDKRAawKx2WAfoTOjfcLGMikSBcMWr_tO3zwayaAibbYaSThdIN19iO_fPiNrzQYPWT1ZR_8aGn2UA9OCKAWZ_R7s8aDnEomFHPOQRPtuwBd_bnvHDuUsyjVmKZks8S8_hlaXusSujre9j8Jl42_btYK1e97EZYEKEq55t1746B2-k Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 35df61dc9f3544a4ad9fa3be324d1e8b Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:46:42.889672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35df61dc9f3544a4ad9fa3be324d1e8b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 35df61dc9f3544a4ad9fa3be324d1e8b Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-DeleteServersTestJSON-1230262323-project Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 3b8a3e35ce254868bf3825cf60139979 Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-DeleteServersTestJSON-1230262323-project Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.891039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '0bf84814-c021-401e-90d4-3b71f83a14a2'} Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:46:42.892156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.893242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.895748 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Returning 404 to user: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:46:42.896668 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9a7820ed-31e0-4a90-8d17-6eff6b0c932e tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 404 len: 111 microversion: 2.1 time: 0.070136 Jun 22 11:46:42.897418 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 123/216] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:46:42 2022] DELETE /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:46:42.906648 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:42.908379 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] [instance: 0bf84814-c021-401e-90d4-3b71f83a14a2] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:42.916915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:42.917729 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:42.919408 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:42.920140 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:42.928330 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:42.959763 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] HTTP exception thrown: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Request method failure captured: Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 HTTP/1.1 Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswDKRAawKx2WAfoTOjfcLGMikSBcMWr_tO3zwayaAibbYaSThdIN19iO_fPiNrzQYPWT1ZR_8aGn2UA9OCKAWZ_R7s8aDnEomFHPOQRPtuwBd_bnvHDuUsyjVmKZks8S8_hlaXusSujre9j8Jl42_btYK1e97EZYEKEq55t1746B2-k Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 35df61dc9f3544a4ad9fa3be324d1e8b Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:46:42.967487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35df61dc9f3544a4ad9fa3be324d1e8b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35df61dc9f3544a4ad9fa3be324d1e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 35df61dc9f3544a4ad9fa3be324d1e8b Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-DeleteServersTestJSON-1230262323 Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-DeleteServersTestJSON-1230262323-project Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 3b8a3e35ce254868bf3825cf60139979 Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-DeleteServersTestJSON-1230262323-project Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.969367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '0bf84814-c021-401e-90d4-3b71f83a14a2'} Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:46:42.970061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. Jun 22 11:46:42.971160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:46:42.973127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] Returning 404 to user: Instance 0bf84814-c021-401e-90d4-3b71f83a14a2 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:46:42.973127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f5b3c0dd-8c3e-4f14-ac5b-3dabeeaa0c37 tempest-DeleteServersTestJSON-1230262323 tempest-DeleteServersTestJSON-1230262323-project] 10.222.0.36 "GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2" status: 404 len: 111 microversion: 2.1 time: 0.067730 Jun 22 11:46:42.973127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 94/217] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:42 2022] GET /compute/v2.1/servers/0bf84814-c021-401e-90d4-3b71f83a14a2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 11:46:43.002794 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ba576044-c446-40f0-884c-e0e8e06c1d19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:43.003626 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ba576044-c446-40f0-884c-e0e8e06c1d19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:43.012946 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba576044-c446-40f0-884c-e0e8e06c1d19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:43.020561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba576044-c446-40f0-884c-e0e8e06c1d19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:43.023014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba576044-c446-40f0-884c-e0e8e06c1d19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:43.023584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba576044-c446-40f0-884c-e0e8e06c1d19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:43.345134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-8006e366-1bf1-4373-9969-4742e1dc3b6a req-e7615afb-aa2d-4690-9125-52bf98c5a0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcefa6c7-6fa4-44e7-95bf-6498b425f3a0", "tag": "acb47374-b90e-48a5-9d9f-66fb1aca360a"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:43.416916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-8006e366-1bf1-4373-9969-4742e1dc3b6a req-e7615afb-aa2d-4690-9125-52bf98c5a0a0 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:43.419520 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-8006e366-1bf1-4373-9969-4742e1dc3b6a req-e7615afb-aa2d-4690-9125-52bf98c5a0a0 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:43.480573 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-8006e366-1bf1-4373-9969-4742e1dc3b6a req-e7615afb-aa2d-4690-9125-52bf98c5a0a0 service nova] Creating event network-changed:acb47374-b90e-48a5-9d9f-66fb1aca360a for instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 on hv-cinder-83697 Jun 22 11:46:43.486836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-8006e366-1bf1-4373-9969-4742e1dc3b6a req-e7615afb-aa2d-4690-9125-52bf98c5a0a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146840 Jun 22 11:46:43.488111 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 95/218] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:46:43.533416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ba576044-c446-40f0-884c-e0e8e06c1d19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:43.556882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ba576044-c446-40f0-884c-e0e8e06c1d19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1502 microversion: 2.1 time: 0.558729 Jun 22 11:46:43.560071 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c25c90fe-2641-4480-b9d0-8a90c1c65229 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:43.566083 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c25c90fe-2641-4480-b9d0-8a90c1c65229 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:43.575594 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 124/219] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:42 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1502 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:43.581305 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c25c90fe-2641-4480-b9d0-8a90c1c65229 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:43.582732 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c25c90fe-2641-4480-b9d0-8a90c1c65229 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:43.584771 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c25c90fe-2641-4480-b9d0-8a90c1c65229 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:43.585910 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c25c90fe-2641-4480-b9d0-8a90c1c65229 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:43.790806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2af17aeb-dc1a-4ceb-b71d-95b0612321ee tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:43.792291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2af17aeb-dc1a-4ceb-b71d-95b0612321ee tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:43.810854 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2af17aeb-dc1a-4ceb-b71d-95b0612321ee tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:43.812887 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2af17aeb-dc1a-4ceb-b71d-95b0612321ee tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:43.814296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2af17aeb-dc1a-4ceb-b71d-95b0612321ee tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:43.814800 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2af17aeb-dc1a-4ceb-b71d-95b0612321ee tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:44.251039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c25c90fe-2641-4480-b9d0-8a90c1c65229 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:44.266485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c25c90fe-2641-4480-b9d0-8a90c1c65229 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.711450 Jun 22 11:46:44.269026 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 96/220] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:43 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:44.304902 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2af17aeb-dc1a-4ceb-b71d-95b0612321ee tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:44.319325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2af17aeb-dc1a-4ceb-b71d-95b0612321ee tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.537983 Jun 22 11:46:44.320900 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 125/221] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:43 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:44.581055 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:44.582153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:44.589920 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:44.590614 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:44.591580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:44.592320 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:44.633626 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:44.634038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:44.634485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lazy-loading 'fault' on Instance uuid 6559025b-55fc-4312-b71d-77108f3d3aaf {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:46:44.741000 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:44.759326 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d12cc25b-3239-41df-84b5-214e1a625439 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 200 len: 1303 microversion: 2.1 time: 0.183517 Jun 22 11:46:44.763631 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 97/222] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:44 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:45.286337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-eb66c891-4d6c-4249-bef2-7cc1e6889e4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:45.287766 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-eb66c891-4d6c-4249-bef2-7cc1e6889e4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:45.297550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb66c891-4d6c-4249-bef2-7cc1e6889e4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:45.298251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb66c891-4d6c-4249-bef2-7cc1e6889e4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:45.299239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb66c891-4d6c-4249-bef2-7cc1e6889e4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:45.299918 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb66c891-4d6c-4249-bef2-7cc1e6889e4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:45.346325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c7085338-d8ef-4f8c-8b6f-b4e2a9efad15 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:45.347456 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c7085338-d8ef-4f8c-8b6f-b4e2a9efad15 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:45.358286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c7085338-d8ef-4f8c-8b6f-b4e2a9efad15 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:45.358831 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c7085338-d8ef-4f8c-8b6f-b4e2a9efad15 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:45.360260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c7085338-d8ef-4f8c-8b6f-b4e2a9efad15 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:45.360745 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c7085338-d8ef-4f8c-8b6f-b4e2a9efad15 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:45.677069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-eb66c891-4d6c-4249-bef2-7cc1e6889e4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:45.689189 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-eb66c891-4d6c-4249-bef2-7cc1e6889e4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.406900 Jun 22 11:46:45.689775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 126/223] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:45 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:45.694818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-ea357cdd-462d-4368-8742-595547e2580b req-6e779e56-e44b-4698-a0ae-6c7f06eb54bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6559025b-55fc-4312-b71d-77108f3d3aaf", "name": "network-vif-deleted", "tag": "a0d7f857-7417-4d6c-af08-56af485787f1"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:45.707065 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-ea357cdd-462d-4368-8742-595547e2580b req-6e779e56-e44b-4698-a0ae-6c7f06eb54bd service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:45.707840 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-ea357cdd-462d-4368-8742-595547e2580b req-6e779e56-e44b-4698-a0ae-6c7f06eb54bd service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:45.720146 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-ea357cdd-462d-4368-8742-595547e2580b req-6e779e56-e44b-4698-a0ae-6c7f06eb54bd service nova] Creating event network-vif-deleted:a0d7f857-7417-4d6c-af08-56af485787f1 for instance 6559025b-55fc-4312-b71d-77108f3d3aaf on hv-cinder-83697 Jun 22 11:46:45.725907 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-ea357cdd-462d-4368-8742-595547e2580b req-6e779e56-e44b-4698-a0ae-6c7f06eb54bd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034729 Jun 22 11:46:45.726514 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 127/224] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:46:45.735148 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c7085338-d8ef-4f8c-8b6f-b4e2a9efad15 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:45.746917 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c7085338-d8ef-4f8c-8b6f-b4e2a9efad15 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.407749 Jun 22 11:46:45.747757 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 98/225] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:45 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:45.779157 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:45.779992 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 6559025b-55fc-4312-b71d-77108f3d3aaf] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:45.787874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:45.788358 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:45.789152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:45.789771 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:45.820141 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] HTTP exception thrown: Instance 6559025b-55fc-4312-b71d-77108f3d3aaf could not be found. Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Request method failure captured: Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf HTTP/1.1 Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswD8Pv34pvmtY6M41As65rWvlSpIcl5sfgnkOFealMKYePb8l7bMbJpokHcjs1RlMZQkmxNz1vdFY6iUEkIaqk8JDMkV8spt25O1UoXXiubHJslUnAxUg_Fs3L-MCtZupv3xnmqtgFa0VG1nvjqRLhfcEvqCgaD_Zctyxty4q-ckFok Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 97d7e536c4254f469c6da669481eb8e6 Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesActionsTest-207689026 Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:46:45.824158 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/97d7e536c4254f469c6da669481eb8e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/97d7e536c4254f469c6da669481eb8e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_97d7e536c4254f469c6da669481eb8e6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/97d7e536c4254f469c6da669481eb8e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesActionsTest-207689026 Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 97d7e536c4254f469c6da669481eb8e6 Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesActionsTest-207689026 Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesActionsTest-207689026-project Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 72365998f1bb459cbff28ca0b267fe69 Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesActionsTest-207689026-project Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 6559025b-55fc-4312-b71d-77108f3d3aaf could not be found. Jun 22 11:46:45.826645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '6559025b-55fc-4312-b71d-77108f3d3aaf'} Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6559025b-55fc-4312-b71d-77108f3d3aaf could not be found. Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:46:45.828123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6559025b-55fc-4312-b71d-77108f3d3aaf could not be found. Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6559025b-55fc-4312-b71d-77108f3d3aaf could not be found. Jun 22 11:46:45.831123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:46:45.844904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Returning 404 to user: Instance 6559025b-55fc-4312-b71d-77108f3d3aaf could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:46:45.844904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-676d41cf-d5a2-4ade-9bf7-9388986a85ed tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf" status: 404 len: 111 microversion: 2.1 time: 0.051782 Jun 22 11:46:45.844904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 128/226] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:45 2022] GET /compute/v2.1/servers/6559025b-55fc-4312-b71d-77108f3d3aaf => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:46:46.018413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-127793223", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "networks": [{"uuid": "b4da61dd-cd35-4f64-a49a-6bcce41decb3"}]}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:46.219676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:46.244762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=6 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:46.707183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-af769aa6-0efd-4803-997d-ccf1d2023cb8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:46.707964 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-af769aa6-0efd-4803-997d-ccf1d2023cb8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:46.709800 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:46.723421 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af769aa6-0efd-4803-997d-ccf1d2023cb8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:46.723875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af769aa6-0efd-4803-997d-ccf1d2023cb8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:46.724713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af769aa6-0efd-4803-997d-ccf1d2023cb8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:46.725105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af769aa6-0efd-4803-997d-ccf1d2023cb8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:46.902021 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-af769aa6-0efd-4803-997d-ccf1d2023cb8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:46.910185 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-af769aa6-0efd-4803-997d-ccf1d2023cb8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.207456 Jun 22 11:46:46.910846 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 129/227] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:46 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:46.915673 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d421b056-eafa-4e63-86bd-7fe78325303b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:46.916277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d421b056-eafa-4e63-86bd-7fe78325303b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:46.925225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d421b056-eafa-4e63-86bd-7fe78325303b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:46.925792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d421b056-eafa-4e63-86bd-7fe78325303b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:46.927298 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d421b056-eafa-4e63-86bd-7fe78325303b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:46.928456 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d421b056-eafa-4e63-86bd-7fe78325303b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:47.085009 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d421b056-eafa-4e63-86bd-7fe78325303b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:47.092973 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d421b056-eafa-4e63-86bd-7fe78325303b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.180966 Jun 22 11:46:47.093597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 130/228] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:46 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:47.938189 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a088f8f4-09f8-4ab1-9e47-829dee82e64d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:47.943473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a088f8f4-09f8-4ab1-9e47-829dee82e64d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:47.949474 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a088f8f4-09f8-4ab1-9e47-829dee82e64d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:47.950013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a088f8f4-09f8-4ab1-9e47-829dee82e64d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:47.951636 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a088f8f4-09f8-4ab1-9e47-829dee82e64d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:47.955305 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a088f8f4-09f8-4ab1-9e47-829dee82e64d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:48.113060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a088f8f4-09f8-4ab1-9e47-829dee82e64d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:48.121329 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a088f8f4-09f8-4ab1-9e47-829dee82e64d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.194996 Jun 22 11:46:48.121908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 131/229] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:47 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:48.127578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-61e983d6-7903-4ed6-a704-be40a8ecd61d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:48.128184 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-61e983d6-7903-4ed6-a704-be40a8ecd61d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:48.134403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-61e983d6-7903-4ed6-a704-be40a8ecd61d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:48.134870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-61e983d6-7903-4ed6-a704-be40a8ecd61d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:48.135674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-61e983d6-7903-4ed6-a704-be40a8ecd61d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:48.136109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-61e983d6-7903-4ed6-a704-be40a8ecd61d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:48.277767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-61e983d6-7903-4ed6-a704-be40a8ecd61d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:48.288619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-61e983d6-7903-4ed6-a704-be40a8ecd61d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.165464 Jun 22 11:46:48.289609 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 132/230] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:48 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:49.137918 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1f0a7afd-e3d5-49eb-8e24-ae7cbdafda16 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:49.138505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1f0a7afd-e3d5-49eb-8e24-ae7cbdafda16 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:49.145620 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f0a7afd-e3d5-49eb-8e24-ae7cbdafda16 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:49.146067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f0a7afd-e3d5-49eb-8e24-ae7cbdafda16 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:49.146837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f0a7afd-e3d5-49eb-8e24-ae7cbdafda16 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:49.147414 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f0a7afd-e3d5-49eb-8e24-ae7cbdafda16 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:49.289286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1f0a7afd-e3d5-49eb-8e24-ae7cbdafda16 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:49.298385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1f0a7afd-e3d5-49eb-8e24-ae7cbdafda16 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.164174 Jun 22 11:46:49.299000 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 133/231] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:49 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:49.311831 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8f4c4646-0445-4b54-8e67-ab29cb06cae0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:49.312945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8f4c4646-0445-4b54-8e67-ab29cb06cae0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:49.320448 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f4c4646-0445-4b54-8e67-ab29cb06cae0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:49.320448 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f4c4646-0445-4b54-8e67-ab29cb06cae0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:49.320650 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f4c4646-0445-4b54-8e67-ab29cb06cae0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:49.320955 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f4c4646-0445-4b54-8e67-ab29cb06cae0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:49.456804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8f4c4646-0445-4b54-8e67-ab29cb06cae0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:49.464435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8f4c4646-0445-4b54-8e67-ab29cb06cae0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.157141 Jun 22 11:46:49.465572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 134/232] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:49 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:50.316961 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f3a44e82-0dda-4c54-9cfd-577cb57248d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:50.318195 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f3a44e82-0dda-4c54-9cfd-577cb57248d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:50.326360 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f3a44e82-0dda-4c54-9cfd-577cb57248d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:50.327159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f3a44e82-0dda-4c54-9cfd-577cb57248d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:50.327919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f3a44e82-0dda-4c54-9cfd-577cb57248d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:50.328505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f3a44e82-0dda-4c54-9cfd-577cb57248d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:50.486204 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f3a44e82-0dda-4c54-9cfd-577cb57248d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:50.499493 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f3a44e82-0dda-4c54-9cfd-577cb57248d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.186209 Jun 22 11:46:50.500618 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 135/233] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:50 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:50.505763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-de5ac606-378d-482b-aa7f-a2762d21f8e3 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:50.506621 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-de5ac606-378d-482b-aa7f-a2762d21f8e3 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:50.513270 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-de5ac606-378d-482b-aa7f-a2762d21f8e3 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:50.514018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-de5ac606-378d-482b-aa7f-a2762d21f8e3 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:50.515006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-de5ac606-378d-482b-aa7f-a2762d21f8e3 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:50.515730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-de5ac606-378d-482b-aa7f-a2762d21f8e3 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:50.994439 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-de5ac606-378d-482b-aa7f-a2762d21f8e3 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:51.002827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-de5ac606-378d-482b-aa7f-a2762d21f8e3 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.500782 Jun 22 11:46:51.003652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 136/234] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:50 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:51.519068 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-42d7f7f1-643f-4385-be28-5684058c86d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:51.519846 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-42d7f7f1-643f-4385-be28-5684058c86d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:51.529088 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-42d7f7f1-643f-4385-be28-5684058c86d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:51.529889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-42d7f7f1-643f-4385-be28-5684058c86d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:51.531988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-42d7f7f1-643f-4385-be28-5684058c86d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:51.532841 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-42d7f7f1-643f-4385-be28-5684058c86d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:51.736560 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-42d7f7f1-643f-4385-be28-5684058c86d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:51.745796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-42d7f7f1-643f-4385-be28-5684058c86d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.231764 Jun 22 11:46:51.746738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 137/235] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:51 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:52.021271 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f0742cbb-6104-477f-9477-b9983b555d04 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:52.022856 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f0742cbb-6104-477f-9477-b9983b555d04 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:52.030258 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f0742cbb-6104-477f-9477-b9983b555d04 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:52.030980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f0742cbb-6104-477f-9477-b9983b555d04 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:52.031972 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f0742cbb-6104-477f-9477-b9983b555d04 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:52.032558 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f0742cbb-6104-477f-9477-b9983b555d04 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:52.212670 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f0742cbb-6104-477f-9477-b9983b555d04 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:52.220808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f0742cbb-6104-477f-9477-b9983b555d04 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.203705 Jun 22 11:46:52.221384 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 138/236] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:52 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:52.771870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0bd04b9c-d74b-41bf-a848-8cb9e8879904 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:52.774460 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0bd04b9c-d74b-41bf-a848-8cb9e8879904 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:52.793717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0bd04b9c-d74b-41bf-a848-8cb9e8879904 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:52.794626 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0bd04b9c-d74b-41bf-a848-8cb9e8879904 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:52.800090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0bd04b9c-d74b-41bf-a848-8cb9e8879904 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:52.800090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0bd04b9c-d74b-41bf-a848-8cb9e8879904 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:52.826489 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:53.047879 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0bd04b9c-d74b-41bf-a848-8cb9e8879904 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:53.072392 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0bd04b9c-d74b-41bf-a848-8cb9e8879904 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.309256 Jun 22 11:46:53.073088 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 139/237] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:52 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:53.237949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9fb32471-4368-49b4-9e5c-b6a6f9ff0963 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:53.239161 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9fb32471-4368-49b4-9e5c-b6a6f9ff0963 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:53.245988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9fb32471-4368-49b4-9e5c-b6a6f9ff0963 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:53.246910 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9fb32471-4368-49b4-9e5c-b6a6f9ff0963 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:53.248959 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9fb32471-4368-49b4-9e5c-b6a6f9ff0963 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:53.249952 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9fb32471-4368-49b4-9e5c-b6a6f9ff0963 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:53.445600 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] validate_networks() for [('b4da61dd-cd35-4f64-a49a-6bcce41decb3', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:46:53.630298 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9fb32471-4368-49b4-9e5c-b6a6f9ff0963 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:53.639064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9fb32471-4368-49b4-9e5c-b6a6f9ff0963 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.404647 Jun 22 11:46:53.640331 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 140/238] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:53 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:54.071125 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:46:54.073008 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:46:54.073526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:46:54.073941 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:46:54.074354 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:46:54.085555 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:54.096593 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f3f6a929-e429-43d9-9b3a-6dbbf9e68882 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:54.098219 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f3f6a929-e429-43d9-9b3a-6dbbf9e68882 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:54.106470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:54.106926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:54.107794 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:54.108046 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f3f6a929-e429-43d9-9b3a-6dbbf9e68882 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:54.108411 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:54.109609 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f3f6a929-e429-43d9-9b3a-6dbbf9e68882 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:54.110815 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f3f6a929-e429-43d9-9b3a-6dbbf9e68882 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:54.115769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f3f6a929-e429-43d9-9b3a-6dbbf9e68882 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:54.139660 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Getting quotas for project 97d7e536c4254f469c6da669481eb8e6. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:46:54.156736 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Getting quotas for user 72365998f1bb459cbff28ca0b267fe69 and project 97d7e536c4254f469c6da669481eb8e6. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:46:54.173210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:46:54.175715 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:46:54.261486 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f4e9c024-782d-4007-a623-4122e9130bae tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.249329 Jun 22 11:46:54.262766 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 99/239] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:46:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 8252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:46:54.275196 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fe2102d0-1376-4a37-8522-c858edcfb4af tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:54.275838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-fe2102d0-1376-4a37-8522-c858edcfb4af tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:54.357971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fe2102d0-1376-4a37-8522-c858edcfb4af tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:54.367199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-fe2102d0-1376-4a37-8522-c858edcfb4af tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1213 microversion: 2.1 time: 0.097978 Jun 22 11:46:54.377764 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 100/240] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:54 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:54.475067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f3f6a929-e429-43d9-9b3a-6dbbf9e68882 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:54.499437 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f3f6a929-e429-43d9-9b3a-6dbbf9e68882 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.412739 Jun 22 11:46:54.500061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 141/241] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:54 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:54.659382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-155ae234-3a42-4c48-ac37-1c045c9714dd tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:54.660147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-155ae234-3a42-4c48-ac37-1c045c9714dd tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:54.668107 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-155ae234-3a42-4c48-ac37-1c045c9714dd tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:54.669299 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-155ae234-3a42-4c48-ac37-1c045c9714dd tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:54.671324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-155ae234-3a42-4c48-ac37-1c045c9714dd tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:54.673013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-155ae234-3a42-4c48-ac37-1c045c9714dd tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:54.878704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-155ae234-3a42-4c48-ac37-1c045c9714dd tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:54.888449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-155ae234-3a42-4c48-ac37-1c045c9714dd tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.232779 Jun 22 11:46:54.900250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 101/242] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:54 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:54.987280 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-21bf03e5-3645-4b31-a460-0a54476cf8e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'create', calling method: .version_select at 0x7f3ea852c0d0>, body: {"keypair": {"name": "tempest-keypair-1191750830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB95M7cy9a1sg+4QWHXQowAXo3eUWOlAcEB7XVy/gfciGoUUhRB7KLPSCrPWiRMG8DXcEv1KbdiilnXf8ixNcl3ZsfwUresmhomTNHL7UbHD+EgQF4GAROLU3G+QUn6qHw=="}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:55.013706 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-21bf03e5-3645-4b31-a460-0a54476cf8e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Getting quotas for project 6f64ad44d3c247caa7d106861916f245. Resources: {'key_pairs'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:46:55.019085 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-21bf03e5-3645-4b31-a460-0a54476cf8e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Getting quotas for user 034858240ac34e549aa5e0754726f9c6 and project 6f64ad44d3c247caa7d106861916f245. Resources: {'key_pairs'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:46:55.072714 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-21bf03e5-3645-4b31-a460-0a54476cf8e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.246085 Jun 22 11:46:55.073588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 142/243] 10.222.0.36 () {62 vars in 1199 bytes} [Wed Jun 22 11:46:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 11:46:55.386185 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b6a2380b-a026-4717-80fb-1ad799a7e2f7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:55.387133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b6a2380b-a026-4717-80fb-1ad799a7e2f7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:55.394613 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6a2380b-a026-4717-80fb-1ad799a7e2f7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:55.395377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6a2380b-a026-4717-80fb-1ad799a7e2f7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:55.396424 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6a2380b-a026-4717-80fb-1ad799a7e2f7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:55.396976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6a2380b-a026-4717-80fb-1ad799a7e2f7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:55.477781 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b6a2380b-a026-4717-80fb-1ad799a7e2f7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:55.487674 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b6a2380b-a026-4717-80fb-1ad799a7e2f7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1217 microversion: 2.1 time: 0.105291 Jun 22 11:46:55.488682 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 102/244] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:55 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:55.517341 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5e06dcbf-072e-47aa-a71a-43d967d8738f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:55.518962 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5e06dcbf-072e-47aa-a71a-43d967d8738f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:55.525378 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5e06dcbf-072e-47aa-a71a-43d967d8738f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:55.525815 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5e06dcbf-072e-47aa-a71a-43d967d8738f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:55.526621 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5e06dcbf-072e-47aa-a71a-43d967d8738f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:55.527056 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5e06dcbf-072e-47aa-a71a-43d967d8738f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:55.716895 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5e06dcbf-072e-47aa-a71a-43d967d8738f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:55.727826 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5e06dcbf-072e-47aa-a71a-43d967d8738f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.214817 Jun 22 11:46:55.728610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 143/245] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:55 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:55.909034 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0e8ea3db-a071-4576-b917-c90cce41b621 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:55.910385 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0e8ea3db-a071-4576-b917-c90cce41b621 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:55.925248 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0e8ea3db-a071-4576-b917-c90cce41b621 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:55.926482 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0e8ea3db-a071-4576-b917-c90cce41b621 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:55.928050 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0e8ea3db-a071-4576-b917-c90cce41b621 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:55.928931 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0e8ea3db-a071-4576-b917-c90cce41b621 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:56.095086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0e8ea3db-a071-4576-b917-c90cce41b621 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:56.105695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0e8ea3db-a071-4576-b917-c90cce41b621 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.202817 Jun 22 11:46:56.106162 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 103/246] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:55 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:56.506596 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cde2328c-2172-479f-ba95-de16130ebe31 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:56.508009 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cde2328c-2172-479f-ba95-de16130ebe31 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:56.520771 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cde2328c-2172-479f-ba95-de16130ebe31 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:56.522271 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cde2328c-2172-479f-ba95-de16130ebe31 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:56.522956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cde2328c-2172-479f-ba95-de16130ebe31 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:56.523697 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cde2328c-2172-479f-ba95-de16130ebe31 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:56.597252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cde2328c-2172-479f-ba95-de16130ebe31 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:56.607117 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cde2328c-2172-479f-ba95-de16130ebe31 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1217 microversion: 2.1 time: 0.104680 Jun 22 11:46:56.607943 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 144/247] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:56 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:56.692854 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1564474983", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "013daf2a-4a2c-4d6d-87db-478221667b1b"}], "security_groups": [{"name": "tempest-securitygroup--738246320"}], "key_name": "tempest-keypair-1191750830", "user_data": "}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:46:56.753129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ed1f9f6c-bc5b-4d61-af1d-990d30f5c664 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:56.754679 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ed1f9f6c-bc5b-4d61-af1d-990d30f5c664 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:56.767286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ed1f9f6c-bc5b-4d61-af1d-990d30f5c664 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:56.768841 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ed1f9f6c-bc5b-4d61-af1d-990d30f5c664 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:56.770500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ed1f9f6c-bc5b-4d61-af1d-990d30f5c664 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:56.771579 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ed1f9f6c-bc5b-4d61-af1d-990d30f5c664 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:56.815410 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] validate_networks() for [('013daf2a-4a2c-4d6d-87db-478221667b1b', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:46:57.020696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ed1f9f6c-bc5b-4d61-af1d-990d30f5c664 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:57.029628 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ed1f9f6c-bc5b-4d61-af1d-990d30f5c664 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.286215 Jun 22 11:46:57.030212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 145/248] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:56 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:57.128067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-20eda2aa-f7ec-4ca9-9721-19ff98efe1ad tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:57.129051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-20eda2aa-f7ec-4ca9-9721-19ff98efe1ad tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:57.135691 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-20eda2aa-f7ec-4ca9-9721-19ff98efe1ad tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:57.136578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-20eda2aa-f7ec-4ca9-9721-19ff98efe1ad tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:57.137082 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-20eda2aa-f7ec-4ca9-9721-19ff98efe1ad tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:57.137512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-20eda2aa-f7ec-4ca9-9721-19ff98efe1ad tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:57.647248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-20eda2aa-f7ec-4ca9-9721-19ff98efe1ad tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:57.658071 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-20eda2aa-f7ec-4ca9-9721-19ff98efe1ad tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.536248 Jun 22 11:46:57.658657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 146/249] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:57 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:57.665756 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c5f0473a-9371-4002-b76d-c7312fa045c4 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:57.666358 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c5f0473a-9371-4002-b76d-c7312fa045c4 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:57.684949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5f0473a-9371-4002-b76d-c7312fa045c4 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:57.685399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5f0473a-9371-4002-b76d-c7312fa045c4 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:57.685853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:46:57.686320 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5f0473a-9371-4002-b76d-c7312fa045c4 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:57.686584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5f0473a-9371-4002-b76d-c7312fa045c4 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:57.687204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:46:57.687942 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:46:57.688527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:46:57.689885 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:46:57.707902 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:57.708603 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:57.709933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:57.710563 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:57.744812 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Getting quotas for project 6f64ad44d3c247caa7d106861916f245. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:46:57.753411 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Getting quotas for user 034858240ac34e549aa5e0754726f9c6 and project 6f64ad44d3c247caa7d106861916f245. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:46:57.769871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:46:57.772208 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:46:57.777486 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c5f0473a-9371-4002-b76d-c7312fa045c4 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:57.787936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c5f0473a-9371-4002-b76d-c7312fa045c4 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1217 microversion: 2.1 time: 0.128204 Jun 22 11:46:57.788763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 147/250] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:57 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:57.860371 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-12b85008-3198-4c00-9bf3-55e2a788a92c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.172928 Jun 22 11:46:57.861037 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 104/251] 10.222.0.36 () {62 vars in 1187 bytes} [Wed Jun 22 11:46:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 11:46:57.873129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ce7b1fbf-ddd4-4af1-b200-d6ec1aeaff5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:57.874126 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ce7b1fbf-ddd4-4af1-b200-d6ec1aeaff5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:57.877533 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:46:57.973603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ce7b1fbf-ddd4-4af1-b200-d6ec1aeaff5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:57.987467 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ce7b1fbf-ddd4-4af1-b200-d6ec1aeaff5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:57.991857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ce7b1fbf-ddd4-4af1-b200-d6ec1aeaff5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:57.993003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ce7b1fbf-ddd4-4af1-b200-d6ec1aeaff5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1282 microversion: 2.20 time: 0.124905 Jun 22 11:46:57.998844 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 148/252] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:46:57 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1282 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:46:58.047505 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-00b0c3a0-6828-4a00-8bfa-06d596019dc5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:58.049240 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-00b0c3a0-6828-4a00-8bfa-06d596019dc5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:58.068724 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00b0c3a0-6828-4a00-8bfa-06d596019dc5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:58.069183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00b0c3a0-6828-4a00-8bfa-06d596019dc5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:58.071519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00b0c3a0-6828-4a00-8bfa-06d596019dc5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:58.073236 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00b0c3a0-6828-4a00-8bfa-06d596019dc5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:58.252144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-00b0c3a0-6828-4a00-8bfa-06d596019dc5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:58.266141 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-00b0c3a0-6828-4a00-8bfa-06d596019dc5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.223155 Jun 22 11:46:58.268150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 105/253] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:58 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:58.675854 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5800eb28-c2b3-4a7e-8b28-009eacf8aba2 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:58.677213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5800eb28-c2b3-4a7e-8b28-009eacf8aba2 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:58.684867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5800eb28-c2b3-4a7e-8b28-009eacf8aba2 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:58.685767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5800eb28-c2b3-4a7e-8b28-009eacf8aba2 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:58.686700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5800eb28-c2b3-4a7e-8b28-009eacf8aba2 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:58.687695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5800eb28-c2b3-4a7e-8b28-009eacf8aba2 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:58.805480 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-90b36222-a7d2-4230-bc77-397eb95bcada tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:58.807023 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-90b36222-a7d2-4230-bc77-397eb95bcada tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:58.816462 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-90b36222-a7d2-4230-bc77-397eb95bcada tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:58.817149 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-90b36222-a7d2-4230-bc77-397eb95bcada tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:58.818155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-90b36222-a7d2-4230-bc77-397eb95bcada tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:58.818916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-90b36222-a7d2-4230-bc77-397eb95bcada tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:58.838224 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5800eb28-c2b3-4a7e-8b28-009eacf8aba2 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:58.846373 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5800eb28-c2b3-4a7e-8b28-009eacf8aba2 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.175285 Jun 22 11:46:58.847164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 149/254] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:58 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:58.886641 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-90b36222-a7d2-4230-bc77-397eb95bcada tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:58.894847 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-90b36222-a7d2-4230-bc77-397eb95bcada tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1273 microversion: 2.1 time: 0.093421 Jun 22 11:46:58.895438 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 106/255] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:58 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:46:59.010960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:59.011621 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:59.018575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:59.019055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:59.019866 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:59.020306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:59.084672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:59.092629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:59.094285 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:59.095375 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2bd4c47d-7885-49c0-a0c8-85110d518308 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1278 microversion: 2.20 time: 0.088327 Jun 22 11:46:59.095928 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 150/256] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:46:59 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:46:59.284187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1f955026-7c0d-45b0-9b72-95b82b284d7c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:59.284873 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1f955026-7c0d-45b0-9b72-95b82b284d7c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:59.291524 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1f955026-7c0d-45b0-9b72-95b82b284d7c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:59.291971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1f955026-7c0d-45b0-9b72-95b82b284d7c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:59.292725 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1f955026-7c0d-45b0-9b72-95b82b284d7c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:59.293155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1f955026-7c0d-45b0-9b72-95b82b284d7c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:59.420036 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1f955026-7c0d-45b0-9b72-95b82b284d7c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:46:59.428132 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1f955026-7c0d-45b0-9b72-95b82b284d7c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.148343 Jun 22 11:46:59.428700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 107/257] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:59 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:46:59.863328 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b09c6a28-1078-4310-92d5-d8646b36e1c6 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:59.863944 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b09c6a28-1078-4310-92d5-d8646b36e1c6 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:59.870019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b09c6a28-1078-4310-92d5-d8646b36e1c6 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:59.870462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b09c6a28-1078-4310-92d5-d8646b36e1c6 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:59.871212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b09c6a28-1078-4310-92d5-d8646b36e1c6 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:59.871667 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b09c6a28-1078-4310-92d5-d8646b36e1c6 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:59.912383 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0164a8c5-05f3-47a8-bfae-79776e5e0982 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:46:59.913122 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0164a8c5-05f3-47a8-bfae-79776e5e0982 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:46:59.919093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0164a8c5-05f3-47a8-bfae-79776e5e0982 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:59.919574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0164a8c5-05f3-47a8-bfae-79776e5e0982 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:59.920327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0164a8c5-05f3-47a8-bfae-79776e5e0982 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:46:59.920754 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0164a8c5-05f3-47a8-bfae-79776e5e0982 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:46:59.997831 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0164a8c5-05f3-47a8-bfae-79776e5e0982 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:00.008271 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0164a8c5-05f3-47a8-bfae-79776e5e0982 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1273 microversion: 2.1 time: 0.099585 Jun 22 11:47:00.009126 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 108/258] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:59 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:00.028889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b09c6a28-1078-4310-92d5-d8646b36e1c6 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:00.036870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b09c6a28-1078-4310-92d5-d8646b36e1c6 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.177331 Jun 22 11:47:00.037445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 151/259] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:46:59 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:00.113015 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:00.113523 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:00.119570 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:00.120007 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:00.120873 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:00.121303 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:00.182684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:00.191107 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:00.192630 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:00.193709 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-696e0206-fbce-4ce6-b930-789a9c1a7822 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1278 microversion: 2.20 time: 0.084661 Jun 22 11:47:00.194256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 109/260] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:00 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:00.445001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-93a6e894-9a66-433f-903c-c4939d7292bb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:00.445593 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-93a6e894-9a66-433f-903c-c4939d7292bb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:00.451613 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-93a6e894-9a66-433f-903c-c4939d7292bb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:00.452054 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-93a6e894-9a66-433f-903c-c4939d7292bb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:00.452847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-93a6e894-9a66-433f-903c-c4939d7292bb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:00.453271 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-93a6e894-9a66-433f-903c-c4939d7292bb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:00.584811 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-93a6e894-9a66-433f-903c-c4939d7292bb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:00.592338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-93a6e894-9a66-433f-903c-c4939d7292bb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.151245 Jun 22 11:47:00.592899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 152/261] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:00 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:01.026592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0f232dd7-862a-4143-a1ef-35e25663003e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:01.027938 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0f232dd7-862a-4143-a1ef-35e25663003e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:01.035697 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0f232dd7-862a-4143-a1ef-35e25663003e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.036148 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0f232dd7-862a-4143-a1ef-35e25663003e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.037013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0f232dd7-862a-4143-a1ef-35e25663003e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.037468 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0f232dd7-862a-4143-a1ef-35e25663003e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.056042 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1c438c60-d147-4654-a3da-d50aa1923044 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:01.056886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1c438c60-d147-4654-a3da-d50aa1923044 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:01.065946 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1c438c60-d147-4654-a3da-d50aa1923044 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.066442 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1c438c60-d147-4654-a3da-d50aa1923044 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.068171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1c438c60-d147-4654-a3da-d50aa1923044 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.068825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1c438c60-d147-4654-a3da-d50aa1923044 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.112811 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0f232dd7-862a-4143-a1ef-35e25663003e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:01.120905 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0f232dd7-862a-4143-a1ef-35e25663003e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1273 microversion: 2.1 time: 0.098432 Jun 22 11:47:01.121530 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 110/262] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:01 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:01.212716 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:01.213477 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:01.222913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.225836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.227118 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.230952 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.262128 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1c438c60-d147-4654-a3da-d50aa1923044 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:01.274377 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1c438c60-d147-4654-a3da-d50aa1923044 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.223737 Jun 22 11:47:01.277102 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 153/263] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:01 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:01.345793 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:01.354060 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:01.355579 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:01.356673 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e3e04a8c-02ab-4ac8-baef-30269319eb6c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1334 microversion: 2.20 time: 0.148174 Jun 22 11:47:01.357227 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 111/264] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:01 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1334 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:01.609148 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3c3b9602-f968-4cc5-b788-2ea65b26377d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:01.611186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3c3b9602-f968-4cc5-b788-2ea65b26377d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:01.621584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c3b9602-f968-4cc5-b788-2ea65b26377d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.622321 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c3b9602-f968-4cc5-b788-2ea65b26377d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.623197 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c3b9602-f968-4cc5-b788-2ea65b26377d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.624006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c3b9602-f968-4cc5-b788-2ea65b26377d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.795040 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-85161b81-9bdd-465f-b46f-2c9adae65cb5 req-549e3c31-de8e-4133-8f59-a547e238af44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcefa6c7-6fa4-44e7-95bf-6498b425f3a0", "name": "network-vif-plugged", "status": "completed", "tag": "acb47374-b90e-48a5-9d9f-66fb1aca360a"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:01.808293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-85161b81-9bdd-465f-b46f-2c9adae65cb5 req-549e3c31-de8e-4133-8f59-a547e238af44 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:01.808981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-85161b81-9bdd-465f-b46f-2c9adae65cb5 req-549e3c31-de8e-4133-8f59-a547e238af44 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:01.823130 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-85161b81-9bdd-465f-b46f-2c9adae65cb5 req-549e3c31-de8e-4133-8f59-a547e238af44 service nova] Creating event network-vif-plugged:acb47374-b90e-48a5-9d9f-66fb1aca360a for instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 on hv-cinder-83697 Jun 22 11:47:01.829266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-85161b81-9bdd-465f-b46f-2c9adae65cb5 req-549e3c31-de8e-4133-8f59-a547e238af44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037864 Jun 22 11:47:01.830505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3c3b9602-f968-4cc5-b788-2ea65b26377d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:01.830769 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 112/265] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:47:01.839230 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3c3b9602-f968-4cc5-b788-2ea65b26377d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.233957 Jun 22 11:47:01.843436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 154/266] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:01 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:02.141440 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8659dc86-03a2-411a-b5e7-db33811d537a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:02.142396 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8659dc86-03a2-411a-b5e7-db33811d537a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:02.148533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8659dc86-03a2-411a-b5e7-db33811d537a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:02.148970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8659dc86-03a2-411a-b5e7-db33811d537a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:02.149710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8659dc86-03a2-411a-b5e7-db33811d537a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:02.150130 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8659dc86-03a2-411a-b5e7-db33811d537a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:02.277380 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8659dc86-03a2-411a-b5e7-db33811d537a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:02.284750 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8659dc86-03a2-411a-b5e7-db33811d537a tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.148494 Jun 22 11:47:02.285308 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 113/267] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:02 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:02.293878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8a3899ac-3f84-43c8-bcc2-98f94452885a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:02.294507 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8a3899ac-3f84-43c8-bcc2-98f94452885a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:02.300488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8a3899ac-3f84-43c8-bcc2-98f94452885a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:02.300928 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8a3899ac-3f84-43c8-bcc2-98f94452885a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:02.301672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8a3899ac-3f84-43c8-bcc2-98f94452885a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:02.302095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8a3899ac-3f84-43c8-bcc2-98f94452885a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:02.375728 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:02.376333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:02.382471 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:02.382963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:02.383707 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:02.384206 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:02.443915 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8a3899ac-3f84-43c8-bcc2-98f94452885a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:02.451480 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8a3899ac-3f84-43c8-bcc2-98f94452885a tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.161323 Jun 22 11:47:02.452272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 155/268] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:02 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:02.463493 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:02.467077 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:02.472775 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:02.474310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:02.475376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8c44fca4-447a-4c65-b90d-bbdc3f3c35bd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1342 microversion: 2.20 time: 0.104050 Jun 22 11:47:02.475945 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 114/269] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:02 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:02.856348 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9656a966-32a2-42d8-9610-8bfc4a5db910 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:02.856955 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9656a966-32a2-42d8-9610-8bfc4a5db910 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:02.863636 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9656a966-32a2-42d8-9610-8bfc4a5db910 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:02.864069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9656a966-32a2-42d8-9610-8bfc4a5db910 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:02.864841 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9656a966-32a2-42d8-9610-8bfc4a5db910 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:02.865268 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9656a966-32a2-42d8-9610-8bfc4a5db910 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:03.011703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9656a966-32a2-42d8-9610-8bfc4a5db910 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:03.019870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9656a966-32a2-42d8-9610-8bfc4a5db910 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1522 microversion: 2.1 time: 0.167325 Jun 22 11:47:03.029394 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 156/270] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:02 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:03.289226 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-da43d35b-7e9f-4024-9fe8-07508dd2ebe7 req-3701f4e2-dc3d-4b6b-8f0e-6ae8d51477fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a02ae69-7dd2-492d-883b-5d0be07889a6", "tag": "19b98890-f86b-425f-a5fa-2857001a8214"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:03.298154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-da43d35b-7e9f-4024-9fe8-07508dd2ebe7 req-3701f4e2-dc3d-4b6b-8f0e-6ae8d51477fe service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:03.298857 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-da43d35b-7e9f-4024-9fe8-07508dd2ebe7 req-3701f4e2-dc3d-4b6b-8f0e-6ae8d51477fe service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:03.302073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-093bc052-3f91-45f3-ba22-c608c2d5d619 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:03.302838 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-093bc052-3f91-45f3-ba22-c608c2d5d619 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:03.309624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-093bc052-3f91-45f3-ba22-c608c2d5d619 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:03.310067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-093bc052-3f91-45f3-ba22-c608c2d5d619 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:03.311154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-093bc052-3f91-45f3-ba22-c608c2d5d619 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:03.312145 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-093bc052-3f91-45f3-ba22-c608c2d5d619 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:03.449576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-da43d35b-7e9f-4024-9fe8-07508dd2ebe7 req-3701f4e2-dc3d-4b6b-8f0e-6ae8d51477fe service nova] Creating event network-changed:19b98890-f86b-425f-a5fa-2857001a8214 for instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 on hv-cinder-83697 Jun 22 11:47:03.455093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-da43d35b-7e9f-4024-9fe8-07508dd2ebe7 req-3701f4e2-dc3d-4b6b-8f0e-6ae8d51477fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169662 Jun 22 11:47:03.455841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 115/271] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:47:03.456036 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-093bc052-3f91-45f3-ba22-c608c2d5d619 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:03.463650 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-093bc052-3f91-45f3-ba22-c608c2d5d619 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.165646 Jun 22 11:47:03.464222 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 157/272] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:03 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:03.470390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-02d3e4b7-1cb2-4105-b1c3-8a84188611aa tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:03.471077 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-02d3e4b7-1cb2-4105-b1c3-8a84188611aa tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:03.477874 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-02d3e4b7-1cb2-4105-b1c3-8a84188611aa tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:03.477874 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-02d3e4b7-1cb2-4105-b1c3-8a84188611aa tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:03.478637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-02d3e4b7-1cb2-4105-b1c3-8a84188611aa tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:03.479062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-02d3e4b7-1cb2-4105-b1c3-8a84188611aa tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:03.494601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:03.495686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:03.502002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:03.502441 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:03.503361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:03.503952 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:03.508144 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:03.583785 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:03.594048 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:03.596355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:03.597052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bb23ec22-2a22-45a2-80d8-cdf2ee78ddf7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1340 microversion: 2.20 time: 0.107133 Jun 22 11:47:03.597915 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 158/273] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:03 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:03.645745 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-02d3e4b7-1cb2-4105-b1c3-8a84188611aa tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:03.653925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-02d3e4b7-1cb2-4105-b1c3-8a84188611aa tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.188181 Jun 22 11:47:03.663692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 116/274] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:03 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:04.037338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-dbe9701f-0484-45b4-8f88-3e483d9d4be7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:04.037999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-dbe9701f-0484-45b4-8f88-3e483d9d4be7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:04.044405 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbe9701f-0484-45b4-8f88-3e483d9d4be7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.045361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbe9701f-0484-45b4-8f88-3e483d9d4be7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.045595 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbe9701f-0484-45b4-8f88-3e483d9d4be7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.046229 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbe9701f-0484-45b4-8f88-3e483d9d4be7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.203908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-dbe9701f-0484-45b4-8f88-3e483d9d4be7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:04.211632 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-dbe9701f-0484-45b4-8f88-3e483d9d4be7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1502 microversion: 2.1 time: 0.178097 Jun 22 11:47:04.212197 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 159/275] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:04 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:04.228080 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e18ee788-4ee3-44fd-bd1e-e0ebc243b2e5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:04.228692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e18ee788-4ee3-44fd-bd1e-e0ebc243b2e5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:04.235427 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e18ee788-4ee3-44fd-bd1e-e0ebc243b2e5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.235904 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e18ee788-4ee3-44fd-bd1e-e0ebc243b2e5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.236643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e18ee788-4ee3-44fd-bd1e-e0ebc243b2e5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.237073 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e18ee788-4ee3-44fd-bd1e-e0ebc243b2e5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.395813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e18ee788-4ee3-44fd-bd1e-e0ebc243b2e5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:04.403943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e18ee788-4ee3-44fd-bd1e-e0ebc243b2e5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1516 microversion: 2.1 time: 0.179651 Jun 22 11:47:04.404500 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 117/276] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:04 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:04.481724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-487e8707-626d-4be4-a1d2-80f674b5ae18 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:04.482981 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-487e8707-626d-4be4-a1d2-80f674b5ae18 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:04.491666 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-487e8707-626d-4be4-a1d2-80f674b5ae18 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.492342 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-487e8707-626d-4be4-a1d2-80f674b5ae18 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.493629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-487e8707-626d-4be4-a1d2-80f674b5ae18 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.494213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-487e8707-626d-4be4-a1d2-80f674b5ae18 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.616109 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:04.616731 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:04.623257 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.623919 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.625325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.625924 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.658784 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-487e8707-626d-4be4-a1d2-80f674b5ae18 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:04.672851 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-487e8707-626d-4be4-a1d2-80f674b5ae18 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.195645 Jun 22 11:47:04.673736 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 160/277] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:04 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:04.679998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b8d6f80d-e351-47f2-a2df-ec6cda75afff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:04.681047 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b8d6f80d-e351-47f2-a2df-ec6cda75afff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:04.688354 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8d6f80d-e351-47f2-a2df-ec6cda75afff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.688896 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8d6f80d-e351-47f2-a2df-ec6cda75afff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.689783 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8d6f80d-e351-47f2-a2df-ec6cda75afff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:04.690277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8d6f80d-e351-47f2-a2df-ec6cda75afff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:04.881217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:04.889218 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:04.890907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:04.892382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1a2916e7-ee22-48bc-acb6-d50276ca7703 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.280782 Jun 22 11:47:04.893338 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 118/278] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:04 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:04.895531 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b8d6f80d-e351-47f2-a2df-ec6cda75afff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:04.903745 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b8d6f80d-e351-47f2-a2df-ec6cda75afff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.227820 Jun 22 11:47:04.904404 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 161/279] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:04 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:05.690023 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8dbee7d4-4c3e-4332-91ab-6eef6d0e2754 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:05.690632 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8dbee7d4-4c3e-4332-91ab-6eef6d0e2754 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:05.697516 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8dbee7d4-4c3e-4332-91ab-6eef6d0e2754 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:05.697956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8dbee7d4-4c3e-4332-91ab-6eef6d0e2754 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:05.698723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8dbee7d4-4c3e-4332-91ab-6eef6d0e2754 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:05.699316 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8dbee7d4-4c3e-4332-91ab-6eef6d0e2754 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:05.784508 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-6aa08bf6-0e04-4ae6-86b1-4bc0c3ff930e req-1c1800ce-a874-4f07-9f7a-fd7d5b3d3df3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b85599-217c-4d95-a8ef-136d2368cf70", "tag": "4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:05.802419 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-6aa08bf6-0e04-4ae6-86b1-4bc0c3ff930e req-1c1800ce-a874-4f07-9f7a-fd7d5b3d3df3 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:05.802891 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-6aa08bf6-0e04-4ae6-86b1-4bc0c3ff930e req-1c1800ce-a874-4f07-9f7a-fd7d5b3d3df3 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:05.821596 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-6aa08bf6-0e04-4ae6-86b1-4bc0c3ff930e req-1c1800ce-a874-4f07-9f7a-fd7d5b3d3df3 service nova] Creating event network-changed:4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6 for instance f5b85599-217c-4d95-a8ef-136d2368cf70 on hv-cinder-83697 Jun 22 11:47:05.854602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-6aa08bf6-0e04-4ae6-86b1-4bc0c3ff930e req-1c1800ce-a874-4f07-9f7a-fd7d5b3d3df3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077231 Jun 22 11:47:05.860389 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 162/280] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:47:05.890507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8dbee7d4-4c3e-4332-91ab-6eef6d0e2754 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:05.898381 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8dbee7d4-4c3e-4332-91ab-6eef6d0e2754 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.212238 Jun 22 11:47:05.899504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 119/281] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:05 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:05.911089 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:05.911889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:05.919189 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:05.919681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:05.920376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-daa295e2-daa8-40ce-8893-d5072aa554b0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:05.920497 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:05.920886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:05.921001 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-daa295e2-daa8-40ce-8893-d5072aa554b0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:05.927274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-daa295e2-daa8-40ce-8893-d5072aa554b0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:05.927753 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-daa295e2-daa8-40ce-8893-d5072aa554b0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:05.928533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-daa295e2-daa8-40ce-8893-d5072aa554b0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:05.928967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-daa295e2-daa8-40ce-8893-d5072aa554b0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:06.133428 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:06.139686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-daa295e2-daa8-40ce-8893-d5072aa554b0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:06.143098 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:06.145303 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:06.146547 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c591bdbf-f9b9-42e9-adfc-3b2d37a7a172 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.239680 Jun 22 11:47:06.147650 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 163/282] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:05 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:06.149216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-daa295e2-daa8-40ce-8893-d5072aa554b0 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1314 microversion: 2.1 time: 0.231403 Jun 22 11:47:06.150032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 120/283] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:05 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:06.915119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ec8e4e27-f0d2-4584-911d-115d4132090b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:06.915774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ec8e4e27-f0d2-4584-911d-115d4132090b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:06.923298 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec8e4e27-f0d2-4584-911d-115d4132090b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:06.923863 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec8e4e27-f0d2-4584-911d-115d4132090b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:06.924688 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec8e4e27-f0d2-4584-911d-115d4132090b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:06.925096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec8e4e27-f0d2-4584-911d-115d4132090b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:06.946222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c06d37b2-bea3-4cc0-9bac-44adc5153f64 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:06.947568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c06d37b2-bea3-4cc0-9bac-44adc5153f64 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:06.954859 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c06d37b2-bea3-4cc0-9bac-44adc5153f64 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:06.955298 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c06d37b2-bea3-4cc0-9bac-44adc5153f64 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:06.956080 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c06d37b2-bea3-4cc0-9bac-44adc5153f64 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:06.956507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c06d37b2-bea3-4cc0-9bac-44adc5153f64 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:06.982107 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-c06d37b2-bea3-4cc0-9bac-44adc5153f64 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lazy-loading 'flavor' on Instance uuid bf3c3cce-4dbe-44a3-b2df-7e43078812f8 {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:47:07.065919 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c06d37b2-bea3-4cc0-9bac-44adc5153f64 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8/action" status: 200 len: 32 microversion: 2.1 time: 0.123928 Jun 22 11:47:07.066801 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 121/284] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:47:06 2022] POST /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 11:47:07.075910 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d9f775e8-36ee-431c-903f-6aa075400f62 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:07.076596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d9f775e8-36ee-431c-903f-6aa075400f62 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:07.083312 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9f775e8-36ee-431c-903f-6aa075400f62 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.083790 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9f775e8-36ee-431c-903f-6aa075400f62 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.084556 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9f775e8-36ee-431c-903f-6aa075400f62 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.084933 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ec8e4e27-f0d2-4584-911d-115d4132090b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:07.085054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9f775e8-36ee-431c-903f-6aa075400f62 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.092351 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ec8e4e27-f0d2-4584-911d-115d4132090b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.181076 Jun 22 11:47:07.092955 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 164/285] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:06 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:07.165901 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:07.166500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:07.173334 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.173791 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.174547 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.174971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.216324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d9f775e8-36ee-431c-903f-6aa075400f62 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:07.225254 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d9f775e8-36ee-431c-903f-6aa075400f62 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.153274 Jun 22 11:47:07.225904 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 122/286] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:07 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:07.230520 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fd5c3465-ee4e-4743-ad57-aa862acf935b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:07.231127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-fd5c3465-ee4e-4743-ad57-aa862acf935b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:07.238981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fd5c3465-ee4e-4743-ad57-aa862acf935b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.239569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fd5c3465-ee4e-4743-ad57-aa862acf935b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.240225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fd5c3465-ee4e-4743-ad57-aa862acf935b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.240656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fd5c3465-ee4e-4743-ad57-aa862acf935b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.362886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:07.371058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:07.372592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:07.373684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-aefb9f24-4f5e-442f-acd5-350fe02da363 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.211731 Jun 22 11:47:07.374831 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 165/287] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:07 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:07.399978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fd5c3465-ee4e-4743-ad57-aa862acf935b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:07.407507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-fd5c3465-ee4e-4743-ad57-aa862acf935b tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1463 microversion: 2.1 time: 0.180646 Jun 22 11:47:07.408063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 123/288] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:07 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1463 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:07.446815 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-af64ce1b-cc26-403c-9555-8a1500e658a7 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:07.447305 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-af64ce1b-cc26-403c-9555-8a1500e658a7 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:07.453248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af64ce1b-cc26-403c-9555-8a1500e658a7 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.453719 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af64ce1b-cc26-403c-9555-8a1500e658a7 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.454469 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af64ce1b-cc26-403c-9555-8a1500e658a7 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.454897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af64ce1b-cc26-403c-9555-8a1500e658a7 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.478585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-af64ce1b-cc26-403c-9555-8a1500e658a7 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:47:07.554875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-af64ce1b-cc26-403c-9555-8a1500e658a7 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 204 len: 0 microversion: 2.1 time: 0.111640 Jun 22 11:47:07.555488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 166/289] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:47:07 2022] DELETE /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:47:07.563563 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b8dea9ac-ce15-4370-aa9c-ee98f6fb6e0d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:07.564169 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b8dea9ac-ce15-4370-aa9c-ee98f6fb6e0d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:07.570137 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8dea9ac-ce15-4370-aa9c-ee98f6fb6e0d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.570584 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8dea9ac-ce15-4370-aa9c-ee98f6fb6e0d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.571342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8dea9ac-ce15-4370-aa9c-ee98f6fb6e0d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:07.571803 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8dea9ac-ce15-4370-aa9c-ee98f6fb6e0d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:07.702537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b8dea9ac-ce15-4370-aa9c-ee98f6fb6e0d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:07.710012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b8dea9ac-ce15-4370-aa9c-ee98f6fb6e0d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.150317 Jun 22 11:47:07.710589 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 124/290] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:07 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:08.109517 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f31a0cab-ccdf-49a8-b7c7-761f6324b1c3 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:08.110207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f31a0cab-ccdf-49a8-b7c7-761f6324b1c3 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:08.112150 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=6 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:08.117491 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f31a0cab-ccdf-49a8-b7c7-761f6324b1c3 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:08.117936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f31a0cab-ccdf-49a8-b7c7-761f6324b1c3 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:08.118690 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f31a0cab-ccdf-49a8-b7c7-761f6324b1c3 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:08.119119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f31a0cab-ccdf-49a8-b7c7-761f6324b1c3 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:08.244411 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-52046ed5-e924-4f30-8e0d-3b4d79e8421a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:08.244948 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-52046ed5-e924-4f30-8e0d-3b4d79e8421a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:08.246849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:08.247719 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=14 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:08.248750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f31a0cab-ccdf-49a8-b7c7-761f6324b1c3 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:08.254675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52046ed5-e924-4f30-8e0d-3b4d79e8421a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:08.255117 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52046ed5-e924-4f30-8e0d-3b4d79e8421a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:08.255933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52046ed5-e924-4f30-8e0d-3b4d79e8421a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:08.256344 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52046ed5-e924-4f30-8e0d-3b4d79e8421a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:08.256730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f31a0cab-ccdf-49a8-b7c7-761f6324b1c3 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.151365 Jun 22 11:47:08.257299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 167/291] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:08 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:08.389155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-52046ed5-e924-4f30-8e0d-3b4d79e8421a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:08.393110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:08.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:08.397640 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-52046ed5-e924-4f30-8e0d-3b4d79e8421a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.157162 Jun 22 11:47:08.398298 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 125/292] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:08 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:08.403484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:08.403484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:08.403484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:08.403484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:08.669731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:08.678307 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:08.679823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:08.680892 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-887e9e65-0e6b-4291-9113-d5c07d852e00 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.292488 Jun 22 11:47:08.681437 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 168/293] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:08 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:08.727981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-167e4ebb-32d6-4df4-8bf0-b61d99233f2f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:08.728579 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-167e4ebb-32d6-4df4-8bf0-b61d99233f2f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:08.735062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-167e4ebb-32d6-4df4-8bf0-b61d99233f2f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:08.735530 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-167e4ebb-32d6-4df4-8bf0-b61d99233f2f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:08.736278 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-167e4ebb-32d6-4df4-8bf0-b61d99233f2f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:08.736695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-167e4ebb-32d6-4df4-8bf0-b61d99233f2f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:08.860401 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-167e4ebb-32d6-4df4-8bf0-b61d99233f2f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:08.867889 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-167e4ebb-32d6-4df4-8bf0-b61d99233f2f tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.143636 Jun 22 11:47:08.868392 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 126/294] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:08 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:09.274316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2e09fc7a-28f9-46b0-9319-8734a84ce183 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:09.274881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2e09fc7a-28f9-46b0-9319-8734a84ce183 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:09.281454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2e09fc7a-28f9-46b0-9319-8734a84ce183 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:09.281899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2e09fc7a-28f9-46b0-9319-8734a84ce183 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:09.282652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2e09fc7a-28f9-46b0-9319-8734a84ce183 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:09.283078 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2e09fc7a-28f9-46b0-9319-8734a84ce183 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:09.414456 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2e09fc7a-28f9-46b0-9319-8734a84ce183 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:09.414652 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a156ae83-20c2-42f9-b65f-792d0060cbe0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:09.415340 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a156ae83-20c2-42f9-b65f-792d0060cbe0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:09.421953 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2e09fc7a-28f9-46b0-9319-8734a84ce183 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.151622 Jun 22 11:47:09.422121 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a156ae83-20c2-42f9-b65f-792d0060cbe0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:09.422706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a156ae83-20c2-42f9-b65f-792d0060cbe0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:09.422847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 169/295] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:09 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:09.423217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a156ae83-20c2-42f9-b65f-792d0060cbe0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:09.423694 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a156ae83-20c2-42f9-b65f-792d0060cbe0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:09.553746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a156ae83-20c2-42f9-b65f-792d0060cbe0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:09.561163 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a156ae83-20c2-42f9-b65f-792d0060cbe0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.150472 Jun 22 11:47:09.561746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 127/296] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:09 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:09.699311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:09.699941 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:09.706492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:09.706930 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:09.707705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:09.708132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:09.840490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:09.848416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:09.849925 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:09.851013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2ea156c6-2f73-4828-aca4-d28807ed1d71 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.155577 Jun 22 11:47:09.851595 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 170/297] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:09 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:09.885402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5256a163-e832-464f-95ef-8ca4e911bc62 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:09.885998 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5256a163-e832-464f-95ef-8ca4e911bc62 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:09.892764 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5256a163-e832-464f-95ef-8ca4e911bc62 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:09.893205 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5256a163-e832-464f-95ef-8ca4e911bc62 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:09.893959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5256a163-e832-464f-95ef-8ca4e911bc62 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:09.894387 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5256a163-e832-464f-95ef-8ca4e911bc62 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:10.024463 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5256a163-e832-464f-95ef-8ca4e911bc62 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:10.036238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5256a163-e832-464f-95ef-8ca4e911bc62 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.154611 Jun 22 11:47:10.036836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 128/298] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:09 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:10.438942 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3288d7ac-a9fa-4f00-8dcc-50523fe7a234 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:10.439566 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3288d7ac-a9fa-4f00-8dcc-50523fe7a234 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:10.445635 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3288d7ac-a9fa-4f00-8dcc-50523fe7a234 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:10.446075 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3288d7ac-a9fa-4f00-8dcc-50523fe7a234 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:10.446822 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3288d7ac-a9fa-4f00-8dcc-50523fe7a234 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:10.447244 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3288d7ac-a9fa-4f00-8dcc-50523fe7a234 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:10.577951 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2420ce61-c2a4-4931-9c12-92bcfd18fe10 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:10.578668 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2420ce61-c2a4-4931-9c12-92bcfd18fe10 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:10.584096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3288d7ac-a9fa-4f00-8dcc-50523fe7a234 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:10.585295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2420ce61-c2a4-4931-9c12-92bcfd18fe10 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:10.585747 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2420ce61-c2a4-4931-9c12-92bcfd18fe10 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:10.586516 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2420ce61-c2a4-4931-9c12-92bcfd18fe10 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:10.586949 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2420ce61-c2a4-4931-9c12-92bcfd18fe10 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:10.591548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3288d7ac-a9fa-4f00-8dcc-50523fe7a234 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.156900 Jun 22 11:47:10.592111 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 171/299] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:10 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:10.713018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2420ce61-c2a4-4931-9c12-92bcfd18fe10 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:10.720995 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2420ce61-c2a4-4931-9c12-92bcfd18fe10 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.146895 Jun 22 11:47:10.721559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 129/300] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:10 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:10.868792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:10.869392 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:10.875401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:10.875850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:10.876604 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:10.877031 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:11.004047 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:11.012467 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:11.014105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:11.015739 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-daf6cc30-3fb5-42e9-afbd-f540f76519d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.150863 Jun 22 11:47:11.016285 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 172/301] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:10 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:11.054084 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e0be0b52-d646-4aac-968c-1794c20c2a35 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:11.054685 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e0be0b52-d646-4aac-968c-1794c20c2a35 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:11.060925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0be0b52-d646-4aac-968c-1794c20c2a35 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:11.061436 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0be0b52-d646-4aac-968c-1794c20c2a35 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:11.062297 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0be0b52-d646-4aac-968c-1794c20c2a35 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:11.062825 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0be0b52-d646-4aac-968c-1794c20c2a35 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:11.066853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:11.197131 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e0be0b52-d646-4aac-968c-1794c20c2a35 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:11.205084 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e0be0b52-d646-4aac-968c-1794c20c2a35 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.154828 Jun 22 11:47:11.205637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 130/302] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:11 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:11.609894 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-53787ced-5fbd-49e7-8128-035929c7b62d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:11.610492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-53787ced-5fbd-49e7-8128-035929c7b62d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:11.616529 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-53787ced-5fbd-49e7-8128-035929c7b62d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:11.616966 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-53787ced-5fbd-49e7-8128-035929c7b62d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:11.617719 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-53787ced-5fbd-49e7-8128-035929c7b62d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:11.618144 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-53787ced-5fbd-49e7-8128-035929c7b62d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:11.738836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-af1d5445-c6fa-40aa-8762-0de9c15de74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:11.740183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-af1d5445-c6fa-40aa-8762-0de9c15de74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:11.747482 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-af1d5445-c6fa-40aa-8762-0de9c15de74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:11.747929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-af1d5445-c6fa-40aa-8762-0de9c15de74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:11.748788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-af1d5445-c6fa-40aa-8762-0de9c15de74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:11.750027 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-af1d5445-c6fa-40aa-8762-0de9c15de74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:11.750617 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-53787ced-5fbd-49e7-8128-035929c7b62d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:11.755539 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:11.762709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-53787ced-5fbd-49e7-8128-035929c7b62d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.156801 Jun 22 11:47:11.763808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 173/303] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:11 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:11.895338 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-af1d5445-c6fa-40aa-8762-0de9c15de74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:11.903739 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-af1d5445-c6fa-40aa-8762-0de9c15de74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.168755 Jun 22 11:47:11.904636 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 131/304] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:11 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:12.035457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:12.036047 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:12.043053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:12.043531 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:12.044284 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:12.044714 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:12.183624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:12.192112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:12.193613 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:12.194701 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-611af7e4-d63c-4643-9bfc-d6c9496ac988 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.163194 Jun 22 11:47:12.195425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 174/305] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:12 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:12.221833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ebca5c54-629b-4631-b141-982c3bad2eca tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:12.222434 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ebca5c54-629b-4631-b141-982c3bad2eca tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:12.228418 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ebca5c54-629b-4631-b141-982c3bad2eca tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:12.228867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ebca5c54-629b-4631-b141-982c3bad2eca tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:12.229661 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ebca5c54-629b-4631-b141-982c3bad2eca tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:12.230050 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ebca5c54-629b-4631-b141-982c3bad2eca tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:12.356695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ebca5c54-629b-4631-b141-982c3bad2eca tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:12.364582 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ebca5c54-629b-4631-b141-982c3bad2eca tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.146557 Jun 22 11:47:12.365140 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 132/306] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:12 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:12.781440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b66718ef-c864-4f3c-934c-dfcf000964a5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:12.782068 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b66718ef-c864-4f3c-934c-dfcf000964a5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:12.788277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b66718ef-c864-4f3c-934c-dfcf000964a5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:12.788728 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b66718ef-c864-4f3c-934c-dfcf000964a5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:12.789478 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b66718ef-c864-4f3c-934c-dfcf000964a5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:12.789905 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b66718ef-c864-4f3c-934c-dfcf000964a5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:12.921594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f5681e86-30ce-46ad-bfb8-d59fed687d42 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:12.922197 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f5681e86-30ce-46ad-bfb8-d59fed687d42 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:12.923658 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b66718ef-c864-4f3c-934c-dfcf000964a5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:12.931490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f5681e86-30ce-46ad-bfb8-d59fed687d42 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:12.931490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f5681e86-30ce-46ad-bfb8-d59fed687d42 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:12.931490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f5681e86-30ce-46ad-bfb8-d59fed687d42 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:12.931490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f5681e86-30ce-46ad-bfb8-d59fed687d42 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:12.932034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b66718ef-c864-4f3c-934c-dfcf000964a5 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.154092 Jun 22 11:47:12.932113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 175/307] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:12 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:13.060017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f5681e86-30ce-46ad-bfb8-d59fed687d42 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:13.067439 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f5681e86-30ce-46ad-bfb8-d59fed687d42 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.150277 Jun 22 11:47:13.067994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 133/308] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:12 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:13.214221 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:13.214816 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:13.223724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:13.224258 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:13.225424 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:13.225717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:13.375123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:13.381435 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-77cb7d9b-d771-436f-a3ff-ddc0d5a618ec tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:13.381943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-77cb7d9b-d771-436f-a3ff-ddc0d5a618ec tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:13.383803 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:13.384064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:13.385735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:13.386833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3fb2e634-a0bc-4877-ae9e-ae7a20c3a127 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.177685 Jun 22 11:47:13.387663 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 176/309] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:13 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:13.390431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-77cb7d9b-d771-436f-a3ff-ddc0d5a618ec tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:13.390879 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-77cb7d9b-d771-436f-a3ff-ddc0d5a618ec tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:13.391953 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-77cb7d9b-d771-436f-a3ff-ddc0d5a618ec tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:13.392564 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-77cb7d9b-d771-436f-a3ff-ddc0d5a618ec tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:13.523965 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-77cb7d9b-d771-436f-a3ff-ddc0d5a618ec tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:13.532151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-77cb7d9b-d771-436f-a3ff-ddc0d5a618ec tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.154721 Jun 22 11:47:13.534571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 134/310] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:13 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:13.949230 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-44fcf571-c0ad-4caf-b206-3ff5c75e0072 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:13.949830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-44fcf571-c0ad-4caf-b206-3ff5c75e0072 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:13.956440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-44fcf571-c0ad-4caf-b206-3ff5c75e0072 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:13.956882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-44fcf571-c0ad-4caf-b206-3ff5c75e0072 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:13.957656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-44fcf571-c0ad-4caf-b206-3ff5c75e0072 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:13.958074 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-44fcf571-c0ad-4caf-b206-3ff5c75e0072 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:14.084098 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-218dfaf6-d140-4bb1-a29b-7be7bc5cd07e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:14.084699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-218dfaf6-d140-4bb1-a29b-7be7bc5cd07e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:14.091489 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-218dfaf6-d140-4bb1-a29b-7be7bc5cd07e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:14.092019 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-218dfaf6-d140-4bb1-a29b-7be7bc5cd07e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:14.093666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-218dfaf6-d140-4bb1-a29b-7be7bc5cd07e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:14.094159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-218dfaf6-d140-4bb1-a29b-7be7bc5cd07e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:14.094525 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-44fcf571-c0ad-4caf-b206-3ff5c75e0072 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:14.104959 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-44fcf571-c0ad-4caf-b206-3ff5c75e0072 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.159942 Jun 22 11:47:14.105534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 177/311] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:13 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:14.111819 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-0fe7b5e6-e6a3-4ff6-bdd6-119526659373 req-9ec3a177-9501-42cd-9cd4-e524279f9f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a02ae69-7dd2-492d-883b-5d0be07889a6", "name": "network-vif-plugged", "status": "completed", "tag": "19b98890-f86b-425f-a5fa-2857001a8214"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:14.121934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-0fe7b5e6-e6a3-4ff6-bdd6-119526659373 req-9ec3a177-9501-42cd-9cd4-e524279f9f60 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:14.122421 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-0fe7b5e6-e6a3-4ff6-bdd6-119526659373 req-9ec3a177-9501-42cd-9cd4-e524279f9f60 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:14.137845 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-0fe7b5e6-e6a3-4ff6-bdd6-119526659373 req-9ec3a177-9501-42cd-9cd4-e524279f9f60 service nova] Creating event network-vif-plugged:19b98890-f86b-425f-a5fa-2857001a8214 for instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 on hv-cinder-83697 Jun 22 11:47:14.143620 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-0fe7b5e6-e6a3-4ff6-bdd6-119526659373 req-9ec3a177-9501-42cd-9cd4-e524279f9f60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036718 Jun 22 11:47:14.144601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 178/312] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:47:14.229569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-218dfaf6-d140-4bb1-a29b-7be7bc5cd07e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:14.237156 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-218dfaf6-d140-4bb1-a29b-7be7bc5cd07e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.156866 Jun 22 11:47:14.237720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 135/313] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:14 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:14.409326 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:14.410299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:14.419979 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:14.421437 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:14.422479 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:14.424494 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:14.549746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ca747928-9f9c-4f27-b4d3-27ca6b21bcff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:14.550477 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ca747928-9f9c-4f27-b4d3-27ca6b21bcff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:14.558205 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca747928-9f9c-4f27-b4d3-27ca6b21bcff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:14.558653 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca747928-9f9c-4f27-b4d3-27ca6b21bcff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:14.560231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca747928-9f9c-4f27-b4d3-27ca6b21bcff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:14.560909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca747928-9f9c-4f27-b4d3-27ca6b21bcff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:14.850740 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:14.864335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:14.867747 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:14.869522 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-17d351af-4303-489d-a068-eb021de0d83c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.465481 Jun 22 11:47:14.871172 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 179/314] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:14 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:14.909135 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ca747928-9f9c-4f27-b4d3-27ca6b21bcff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:14.917042 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ca747928-9f9c-4f27-b4d3-27ca6b21bcff tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.371468 Jun 22 11:47:14.917593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 136/315] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:14 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:15.121836 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8f18c155-78f5-4f8c-8adb-c1d32a4ea3a9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:15.122415 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8f18c155-78f5-4f8c-8adb-c1d32a4ea3a9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:15.128896 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f18c155-78f5-4f8c-8adb-c1d32a4ea3a9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:15.129337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f18c155-78f5-4f8c-8adb-c1d32a4ea3a9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:15.130092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f18c155-78f5-4f8c-8adb-c1d32a4ea3a9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:15.130522 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f18c155-78f5-4f8c-8adb-c1d32a4ea3a9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:15.255103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b8467318-6ee8-4f50-a35f-d12eb5d9ce8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:15.255780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b8467318-6ee8-4f50-a35f-d12eb5d9ce8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:15.262445 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8467318-6ee8-4f50-a35f-d12eb5d9ce8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:15.262894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8467318-6ee8-4f50-a35f-d12eb5d9ce8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:15.263700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8467318-6ee8-4f50-a35f-d12eb5d9ce8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:15.264139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8467318-6ee8-4f50-a35f-d12eb5d9ce8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:15.265157 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8f18c155-78f5-4f8c-8adb-c1d32a4ea3a9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:15.272893 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8f18c155-78f5-4f8c-8adb-c1d32a4ea3a9 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.154991 Jun 22 11:47:15.273451 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 180/316] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:15 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:15.394247 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b8467318-6ee8-4f50-a35f-d12eb5d9ce8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:15.402342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b8467318-6ee8-4f50-a35f-d12eb5d9ce8e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.151397 Jun 22 11:47:15.404706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 137/317] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:15 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:15.889326 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:15.890470 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:15.896623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:15.897060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:15.897813 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:15.898241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:15.934210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c2056690-fe03-42e4-820e-d54c3fce01ed tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:15.935120 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c2056690-fe03-42e4-820e-d54c3fce01ed tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:15.942468 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c2056690-fe03-42e4-820e-d54c3fce01ed tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:15.942906 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c2056690-fe03-42e4-820e-d54c3fce01ed tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:15.946078 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c2056690-fe03-42e4-820e-d54c3fce01ed tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:15.946178 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c2056690-fe03-42e4-820e-d54c3fce01ed tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:16.110677 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:16.118824 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:16.120369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:16.121465 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4f137dcb-6cfd-4310-9535-8893995b9454 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.236086 Jun 22 11:47:16.122019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 181/318] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:15 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:16.151421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c2056690-fe03-42e4-820e-d54c3fce01ed tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:16.159091 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c2056690-fe03-42e4-820e-d54c3fce01ed tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.228762 Jun 22 11:47:16.159937 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 138/319] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:15 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:16.289644 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9f4d9075-e863-473c-a106-df66718caf19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:16.290635 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9f4d9075-e863-473c-a106-df66718caf19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:16.297723 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f4d9075-e863-473c-a106-df66718caf19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:16.298267 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f4d9075-e863-473c-a106-df66718caf19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:16.299102 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f4d9075-e863-473c-a106-df66718caf19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:16.299637 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f4d9075-e863-473c-a106-df66718caf19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:16.430354 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e72fe62a-7723-4fa4-b52c-7a71f9e6fbc4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:16.431061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e72fe62a-7723-4fa4-b52c-7a71f9e6fbc4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:16.439825 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e72fe62a-7723-4fa4-b52c-7a71f9e6fbc4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:16.440270 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e72fe62a-7723-4fa4-b52c-7a71f9e6fbc4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:16.441075 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e72fe62a-7723-4fa4-b52c-7a71f9e6fbc4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:16.441504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e72fe62a-7723-4fa4-b52c-7a71f9e6fbc4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:16.481651 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9f4d9075-e863-473c-a106-df66718caf19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:16.495837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9f4d9075-e863-473c-a106-df66718caf19 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.209902 Jun 22 11:47:16.500076 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 182/320] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:16 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:16.636576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e72fe62a-7723-4fa4-b52c-7a71f9e6fbc4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:16.645056 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e72fe62a-7723-4fa4-b52c-7a71f9e6fbc4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.228701 Jun 22 11:47:16.646082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 139/321] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:16 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:17.144382 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:17.145018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:17.151060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:17.151543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:17.152312 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:17.152754 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:17.176318 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-13697e92-5219-42cc-8e1c-cb3d06f1e9f4 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:17.177106 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-13697e92-5219-42cc-8e1c-cb3d06f1e9f4 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:17.192355 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13697e92-5219-42cc-8e1c-cb3d06f1e9f4 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:17.192910 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13697e92-5219-42cc-8e1c-cb3d06f1e9f4 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:17.193797 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13697e92-5219-42cc-8e1c-cb3d06f1e9f4 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:17.194331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13697e92-5219-42cc-8e1c-cb3d06f1e9f4 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:17.338490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:17.348184 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:17.349805 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:17.351083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1f3a857c-322e-4fed-b36c-c68484e74a1b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.211692 Jun 22 11:47:17.351944 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 183/322] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:17 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:17.369146 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-13697e92-5219-42cc-8e1c-cb3d06f1e9f4 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:17.376850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-13697e92-5219-42cc-8e1c-cb3d06f1e9f4 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.204339 Jun 22 11:47:17.377428 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 140/323] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:17 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:17.515965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6bc39f66-daf7-4990-b3f1-2d2e4ba3dd9d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:17.516832 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6bc39f66-daf7-4990-b3f1-2d2e4ba3dd9d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:17.522921 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bc39f66-daf7-4990-b3f1-2d2e4ba3dd9d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:17.523390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bc39f66-daf7-4990-b3f1-2d2e4ba3dd9d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:17.524162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bc39f66-daf7-4990-b3f1-2d2e4ba3dd9d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:17.524590 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bc39f66-daf7-4990-b3f1-2d2e4ba3dd9d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:17.659970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6bc39f66-daf7-4990-b3f1-2d2e4ba3dd9d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:17.662629 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-024b36d2-1744-4c3b-89cb-77bd557b1027 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:17.663441 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-024b36d2-1744-4c3b-89cb-77bd557b1027 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:17.670830 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-024b36d2-1744-4c3b-89cb-77bd557b1027 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:17.671277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-024b36d2-1744-4c3b-89cb-77bd557b1027 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:17.672590 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-024b36d2-1744-4c3b-89cb-77bd557b1027 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:17.673662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-024b36d2-1744-4c3b-89cb-77bd557b1027 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:17.674075 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6bc39f66-daf7-4990-b3f1-2d2e4ba3dd9d tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.161678 Jun 22 11:47:17.683969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 184/324] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:17 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:17.832819 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-024b36d2-1744-4c3b-89cb-77bd557b1027 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:17.841135 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-024b36d2-1744-4c3b-89cb-77bd557b1027 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.182427 Jun 22 11:47:17.841714 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 141/325] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:17 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:18.370139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:18.371373 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:18.378486 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:18.378933 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:18.379734 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:18.380166 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:18.394160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-676d142a-3f8d-4ec5-965c-37fc616c1c18 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:18.394770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-676d142a-3f8d-4ec5-965c-37fc616c1c18 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:18.402522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-676d142a-3f8d-4ec5-965c-37fc616c1c18 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:18.403017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-676d142a-3f8d-4ec5-965c-37fc616c1c18 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:18.403822 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-676d142a-3f8d-4ec5-965c-37fc616c1c18 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:18.404499 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-676d142a-3f8d-4ec5-965c-37fc616c1c18 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:18.595643 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:18.603672 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-676d142a-3f8d-4ec5-965c-37fc616c1c18 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:18.611397 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:18.613030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:18.613637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-676d142a-3f8d-4ec5-965c-37fc616c1c18 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.224051 Jun 22 11:47:18.614682 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 142/326] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:18 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:18.614807 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cf82f545-84cd-4913-80f4-3fc04dc80eaa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.247983 Jun 22 11:47:18.615077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 185/327] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:18 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:18.691416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-008c0863-e8db-4958-b0e0-7e816d9f4b89 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:18.692343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-008c0863-e8db-4958-b0e0-7e816d9f4b89 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:18.699611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-008c0863-e8db-4958-b0e0-7e816d9f4b89 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:18.700054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-008c0863-e8db-4958-b0e0-7e816d9f4b89 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:18.700804 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-008c0863-e8db-4958-b0e0-7e816d9f4b89 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:18.701225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-008c0863-e8db-4958-b0e0-7e816d9f4b89 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:18.837093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-008c0863-e8db-4958-b0e0-7e816d9f4b89 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:18.844758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-008c0863-e8db-4958-b0e0-7e816d9f4b89 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1313 microversion: 2.1 time: 0.157174 Jun 22 11:47:18.845460 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 143/328] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:18 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:18.857767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-98f10c0e-1299-480a-b3c3-b76ef4de3be2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:18.858376 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-98f10c0e-1299-480a-b3c3-b76ef4de3be2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:18.864789 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-98f10c0e-1299-480a-b3c3-b76ef4de3be2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:18.865238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-98f10c0e-1299-480a-b3c3-b76ef4de3be2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:18.866009 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-98f10c0e-1299-480a-b3c3-b76ef4de3be2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:18.866446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-98f10c0e-1299-480a-b3c3-b76ef4de3be2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:19.015005 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-98f10c0e-1299-480a-b3c3-b76ef4de3be2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:19.023109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-98f10c0e-1299-480a-b3c3-b76ef4de3be2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.169063 Jun 22 11:47:19.023697 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 186/329] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:18 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:19.630651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-53f60098-12d2-4c3c-924b-1386d4cdf4df tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:19.631545 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-53f60098-12d2-4c3c-924b-1386d4cdf4df tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:19.632338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:19.632954 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:19.638103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-53f60098-12d2-4c3c-924b-1386d4cdf4df tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:19.638543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-53f60098-12d2-4c3c-924b-1386d4cdf4df tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:19.639305 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-53f60098-12d2-4c3c-924b-1386d4cdf4df tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:19.639527 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:19.639760 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-53f60098-12d2-4c3c-924b-1386d4cdf4df tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:19.639943 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:19.640688 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:19.641110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:19.860267 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:19.864134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-53f60098-12d2-4c3c-924b-1386d4cdf4df tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:19.870725 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:19.872483 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:19.875709 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-53f60098-12d2-4c3c-924b-1386d4cdf4df tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1469 microversion: 2.1 time: 0.247203 Jun 22 11:47:19.875889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-eb4c9011-d09e-490f-b3c8-ea1509579a23 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.245465 Jun 22 11:47:19.875889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 187/330] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:19 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:19.884402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 144/331] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:19 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:19.887457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3f5f3dba-2355-4b47-ab8a-d31482339720 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:19.888487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3f5f3dba-2355-4b47-ab8a-d31482339720 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:19.898956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3f5f3dba-2355-4b47-ab8a-d31482339720 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:19.899572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3f5f3dba-2355-4b47-ab8a-d31482339720 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:19.901407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3f5f3dba-2355-4b47-ab8a-d31482339720 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:19.902052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3f5f3dba-2355-4b47-ab8a-d31482339720 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.048656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ca99212f-97fb-4b20-8c7a-72a0d0fc145b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:20.051725 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ca99212f-97fb-4b20-8c7a-72a0d0fc145b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:20.068718 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca99212f-97fb-4b20-8c7a-72a0d0fc145b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:20.069203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca99212f-97fb-4b20-8c7a-72a0d0fc145b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.069978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca99212f-97fb-4b20-8c7a-72a0d0fc145b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:20.070410 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca99212f-97fb-4b20-8c7a-72a0d0fc145b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.214638 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3f5f3dba-2355-4b47-ab8a-d31482339720 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:20.226794 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3f5f3dba-2355-4b47-ab8a-d31482339720 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1497 microversion: 2.1 time: 0.351239 Jun 22 11:47:20.227737 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 188/332] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:19 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1497 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:20.250341 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-5d01f412-79a3-4972-ac75-d2de912564e6 req-538028c2-7e6b-4ce5-9e81-4b975a7bd798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcefa6c7-6fa4-44e7-95bf-6498b425f3a0", "name": "network-vif-deleted", "tag": "acb47374-b90e-48a5-9d9f-66fb1aca360a"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:20.262052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-5d01f412-79a3-4972-ac75-d2de912564e6 req-538028c2-7e6b-4ce5-9e81-4b975a7bd798 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:20.262564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-5d01f412-79a3-4972-ac75-d2de912564e6 req-538028c2-7e6b-4ce5-9e81-4b975a7bd798 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.285206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-5d01f412-79a3-4972-ac75-d2de912564e6 req-538028c2-7e6b-4ce5-9e81-4b975a7bd798 service nova] Creating event network-vif-deleted:acb47374-b90e-48a5-9d9f-66fb1aca360a for instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 on hv-cinder-83697 Jun 22 11:47:20.293115 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-5d01f412-79a3-4972-ac75-d2de912564e6 req-538028c2-7e6b-4ce5-9e81-4b975a7bd798 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063571 Jun 22 11:47:20.297721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 189/333] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:47:20.321938 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ca99212f-97fb-4b20-8c7a-72a0d0fc145b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:20.330955 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ca99212f-97fb-4b20-8c7a-72a0d0fc145b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.293873 Jun 22 11:47:20.332357 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 145/334] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:20 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:20.892890 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:20.893575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:20.899918 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:20.900355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.901113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:20.901536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.901644 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:20.902204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:20.908575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:20.909013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.909763 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:20.910206 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.933093 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:20.933451 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:20.933903 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lazy-loading 'fault' on Instance uuid fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:47:21.004758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:21.012298 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3015eb12-e5ad-45eb-8d6f-d0ea8cf37f4d tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1304 microversion: 2.1 time: 0.124917 Jun 22 11:47:21.012992 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 190/335] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:20 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:21.070005 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:21.073376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:21.079129 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:21.080743 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:21.081843 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1381b7d0-c7b3-432f-8ea2-75335bf5c07b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.184226 Jun 22 11:47:21.082396 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 146/336] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:20 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:21.348834 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2c9b7077-ebe1-4775-8f73-1b32240b5336 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:21.349430 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2c9b7077-ebe1-4775-8f73-1b32240b5336 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:21.355519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c9b7077-ebe1-4775-8f73-1b32240b5336 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:21.355956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c9b7077-ebe1-4775-8f73-1b32240b5336 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:21.356718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c9b7077-ebe1-4775-8f73-1b32240b5336 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:21.357128 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c9b7077-ebe1-4775-8f73-1b32240b5336 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:21.375765 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:21.486406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2c9b7077-ebe1-4775-8f73-1b32240b5336 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:21.497700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2c9b7077-ebe1-4775-8f73-1b32240b5336 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.152714 Jun 22 11:47:21.498254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 191/337] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:21 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:22.031422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:22.032049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:22.038568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:22.039012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:22.039793 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:22.040224 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:22.070552 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:22.070987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:22.071515 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lazy-loading 'fault' on Instance uuid fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:47:22.099636 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:22.100342 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:22.106486 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:22.107019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:22.108565 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:22.109019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:22.114643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:22.122024 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-51701ae5-8468-4372-a1e6-55da39857211 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1304 microversion: 2.1 time: 0.095228 Jun 22 11:47:22.122588 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 147/338] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:22 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:22.234897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:22.242658 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:22.244171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:22.245253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5066493e-23c4-40b5-b69e-ecfb4e3dd842 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.149633 Jun 22 11:47:22.245800 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 192/339] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:22 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:22.516104 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d188ff51-758e-400b-95f0-fcc7da411ab8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:22.516842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d188ff51-758e-400b-95f0-fcc7da411ab8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:22.522808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d188ff51-758e-400b-95f0-fcc7da411ab8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:22.523247 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d188ff51-758e-400b-95f0-fcc7da411ab8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:22.524086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d188ff51-758e-400b-95f0-fcc7da411ab8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:22.524516 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d188ff51-758e-400b-95f0-fcc7da411ab8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:22.655293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d188ff51-758e-400b-95f0-fcc7da411ab8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:22.662767 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d188ff51-758e-400b-95f0-fcc7da411ab8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.151672 Jun 22 11:47:22.663321 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 148/340] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:22 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:23.139302 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:23.139936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:23.142717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:23.148669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:23.149112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:23.149882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:23.150315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:23.180819 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:23.181257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:23.181699 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lazy-loading 'fault' on Instance uuid fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:47:23.230790 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3a653cb514e37bad8080d8a5cc7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4829f904e10c4df197b253f1211157af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:23.238297 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-142bc08b-a21e-4319-9735-c4f01499fc08 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 200 len: 1304 microversion: 2.1 time: 0.102826 Jun 22 11:47:23.238862 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 193/341] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:23 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:23.263279 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:23.263906 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:23.271601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:23.272260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:23.272778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:23.273205 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:23.419980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:23.429676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:23.431165 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:23.432282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-098ede26-16a2-43a4-895e-dd1239e07585 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.173122 Jun 22 11:47:23.432829 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 149/342] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:23 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:23.679821 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1165b986-80bf-46d5-a5b4-ed005fac0137 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:23.680348 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1165b986-80bf-46d5-a5b4-ed005fac0137 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:23.687830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1165b986-80bf-46d5-a5b4-ed005fac0137 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:23.688430 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1165b986-80bf-46d5-a5b4-ed005fac0137 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:23.689208 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1165b986-80bf-46d5-a5b4-ed005fac0137 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:23.689644 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1165b986-80bf-46d5-a5b4-ed005fac0137 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:23.821767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1165b986-80bf-46d5-a5b4-ed005fac0137 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:23.830042 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1165b986-80bf-46d5-a5b4-ed005fac0137 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.154166 Jun 22 11:47:23.830608 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 194/343] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:23 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:24.254100 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:24.254612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] [instance: fcefa6c7-6fa4-44e7-95bf-6498b425f3a0] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:24.260583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:24.261029 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:24.261781 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:24.262207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:24.276222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] HTTP exception thrown: Instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 could not be found. Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Request method failure captured: Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 HTTP/1.1 Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswEZcGMDnXDALYThEcSedPVcbpGwUbYxNa9xj-z6r1kmaSn3MmWA4Y1AdlH2l5pF6TNlMRv_tdimIrtykM4fN7sCh-XUt0603myVklSZrA6WTNQlnINXb0WbOLS2Qdy4-cJa6bE7UvrJtTqK7gh6XMyDM5HlOvxmK39H_CimYXgDQWc Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 4829f904e10c4df197b253f1211157af Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-VolumesNegativeTest-1070578354 Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:47:24.277833 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4829f904e10c4df197b253f1211157af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4829f904e10c4df197b253f1211157af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4829f904e10c4df197b253f1211157af", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4829f904e10c4df197b253f1211157af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-VolumesNegativeTest-1070578354 Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 4829f904e10c4df197b253f1211157af Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-VolumesNegativeTest-1070578354 Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-VolumesNegativeTest-1070578354-project Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 6cd3a653cb514e37bad8080d8a5cc7b0 Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-VolumesNegativeTest-1070578354-project Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 could not be found. Jun 22 11:47:24.279242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'fcefa6c7-6fa4-44e7-95bf-6498b425f3a0'} Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 could not be found. Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:47:24.280897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 could not be found. Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 could not be found. Jun 22 11:47:24.282416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:24.283651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] Returning 404 to user: Instance fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:47:24.283651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4e62ac45-837f-4ed4-843e-85e7f9f1c979 tempest-VolumesNegativeTest-1070578354 tempest-VolumesNegativeTest-1070578354-project] 10.222.0.36 "GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0" status: 404 len: 111 microversion: 2.1 time: 0.029061 Jun 22 11:47:24.283651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 150/344] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:24 2022] GET /compute/v2.1/servers/fcefa6c7-6fa4-44e7-95bf-6498b425f3a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:47:24.450597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:24.451292 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:24.458007 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:24.458448 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:24.459214 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:24.459668 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:24.602886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:24.611684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:24.613364 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:24.614456 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7337bfea-8836-46a5-a886-63c7b10fa7fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.167956 Jun 22 11:47:24.615186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 195/345] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:24 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:24.846850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b70b01f6-0865-4537-a639-6ec25232bf77 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:24.847730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b70b01f6-0865-4537-a639-6ec25232bf77 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:24.854094 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b70b01f6-0865-4537-a639-6ec25232bf77 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:24.854797 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b70b01f6-0865-4537-a639-6ec25232bf77 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:24.855767 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b70b01f6-0865-4537-a639-6ec25232bf77 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:24.856195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b70b01f6-0865-4537-a639-6ec25232bf77 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:25.027933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b70b01f6-0865-4537-a639-6ec25232bf77 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:25.036845 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b70b01f6-0865-4537-a639-6ec25232bf77 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.194599 Jun 22 11:47:25.037413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 151/346] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:24 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:25.633154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:25.633828 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:25.640066 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:25.640512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:25.641881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:25.642317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:25.685302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-993c49f9-a6b3-48a1-a219-04699b2d99df tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:25.686713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-993c49f9-a6b3-48a1-a219-04699b2d99df tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:25.703196 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-993c49f9-a6b3-48a1-a219-04699b2d99df tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:25.703725 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-993c49f9-a6b3-48a1-a219-04699b2d99df tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:25.704498 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-993c49f9-a6b3-48a1-a219-04699b2d99df tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:25.704922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-993c49f9-a6b3-48a1-a219-04699b2d99df tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:25.733799 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-993c49f9-a6b3-48a1-a219-04699b2d99df tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:47:25.796104 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:25.804796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:25.806315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:25.807499 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-76eaab5f-c435-4dd9-bd90-547726d31fb9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.178308 Jun 22 11:47:25.808052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 196/347] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:25 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:25.846843 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-993c49f9-a6b3-48a1-a219-04699b2d99df tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 204 len: 0 microversion: 2.1 time: 0.165159 Jun 22 11:47:25.847496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 152/348] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:47:25 2022] DELETE /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 11:47:25.855923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5433e603-5ffd-4fad-b9de-b1526c1b6adc tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:25.856534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5433e603-5ffd-4fad-b9de-b1526c1b6adc tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:25.863807 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5433e603-5ffd-4fad-b9de-b1526c1b6adc tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:25.864267 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5433e603-5ffd-4fad-b9de-b1526c1b6adc tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:25.865033 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5433e603-5ffd-4fad-b9de-b1526c1b6adc tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:25.865468 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5433e603-5ffd-4fad-b9de-b1526c1b6adc tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:26.002405 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5433e603-5ffd-4fad-b9de-b1526c1b6adc tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:26.010809 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5433e603-5ffd-4fad-b9de-b1526c1b6adc tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1503 microversion: 2.1 time: 0.158900 Jun 22 11:47:26.011573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 197/349] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:25 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:26.054192 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c82a19d0-32b9-4ce4-bdc3-d4022e2c99d1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:26.054881 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c82a19d0-32b9-4ce4-bdc3-d4022e2c99d1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:26.061407 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c82a19d0-32b9-4ce4-bdc3-d4022e2c99d1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:26.061845 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c82a19d0-32b9-4ce4-bdc3-d4022e2c99d1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:26.062594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c82a19d0-32b9-4ce4-bdc3-d4022e2c99d1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:26.063015 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c82a19d0-32b9-4ce4-bdc3-d4022e2c99d1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:26.204675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c82a19d0-32b9-4ce4-bdc3-d4022e2c99d1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:26.212502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c82a19d0-32b9-4ce4-bdc3-d4022e2c99d1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.162318 Jun 22 11:47:26.213061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 153/350] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:26 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:26.828235 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:26.829256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:26.835535 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:26.835990 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:26.836788 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:26.837223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:27.018541 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-0e69430f-f9b5-4f80-a8e8-848e1ea1b833 req-6b124749-0f48-4e21-a564-9f4c68fb2f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b85599-217c-4d95-a8ef-136d2368cf70", "name": "network-vif-plugged", "status": "completed", "tag": "4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:27.040497 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-0e69430f-f9b5-4f80-a8e8-848e1ea1b833 req-6b124749-0f48-4e21-a564-9f4c68fb2f6d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:27.041420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-0e69430f-f9b5-4f80-a8e8-848e1ea1b833 req-6b124749-0f48-4e21-a564-9f4c68fb2f6d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:27.066830 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-0e69430f-f9b5-4f80-a8e8-848e1ea1b833 req-6b124749-0f48-4e21-a564-9f4c68fb2f6d service nova] Creating event network-vif-plugged:4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6 for instance f5b85599-217c-4d95-a8ef-136d2368cf70 on hv-cinder-83697 Jun 22 11:47:27.074041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-0e69430f-f9b5-4f80-a8e8-848e1ea1b833 req-6b124749-0f48-4e21-a564-9f4c68fb2f6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064315 Jun 22 11:47:27.075931 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 154/351] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:47:27.084766 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9290db9e-e8ab-4dcd-be47-e8606f90b526 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:27.085860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9290db9e-e8ab-4dcd-be47-e8606f90b526 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:27.094406 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9290db9e-e8ab-4dcd-be47-e8606f90b526 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:27.095199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9290db9e-e8ab-4dcd-be47-e8606f90b526 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:27.096388 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9290db9e-e8ab-4dcd-be47-e8606f90b526 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:27.097035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9290db9e-e8ab-4dcd-be47-e8606f90b526 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:27.303550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:27.312690 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:27.314419 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:27.315759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-027bc487-ac78-4fec-a654-3d11329994fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.493491 Jun 22 11:47:27.316627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 198/352] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:26 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:27.327627 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9290db9e-e8ab-4dcd-be47-e8606f90b526 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:27.333054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9290db9e-e8ab-4dcd-be47-e8606f90b526 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1503 microversion: 2.1 time: 0.255701 Jun 22 11:47:27.333584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-85033408-2423-47d6-b3ab-ecb62fc59fe4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:27.334495 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-85033408-2423-47d6-b3ab-ecb62fc59fe4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:27.343024 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-85033408-2423-47d6-b3ab-ecb62fc59fe4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:27.343261 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 155/353] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:27 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:27.343503 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-85033408-2423-47d6-b3ab-ecb62fc59fe4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:27.344324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-85033408-2423-47d6-b3ab-ecb62fc59fe4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:27.344888 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-85033408-2423-47d6-b3ab-ecb62fc59fe4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:27.488227 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-85033408-2423-47d6-b3ab-ecb62fc59fe4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:27.496653 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-85033408-2423-47d6-b3ab-ecb62fc59fe4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.167051 Jun 22 11:47:27.497205 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 199/354] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:27 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:28.334082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:28.334783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:28.341285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:28.341808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:28.343136 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:28.343609 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:28.350057 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cc6174d5-48a5-48d4-a727-50d76e74b821 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:28.350768 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cc6174d5-48a5-48d4-a727-50d76e74b821 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:28.357394 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc6174d5-48a5-48d4-a727-50d76e74b821 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:28.358507 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc6174d5-48a5-48d4-a727-50d76e74b821 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:28.359430 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc6174d5-48a5-48d4-a727-50d76e74b821 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:28.359860 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc6174d5-48a5-48d4-a727-50d76e74b821 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:28.549956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:28.554884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cc6174d5-48a5-48d4-a727-50d76e74b821 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:28.558349 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:28.559894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:28.561762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d34508af-0205-4cf0-8f5f-244edb0a0ead tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.231006 Jun 22 11:47:28.563708 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cc6174d5-48a5-48d4-a727-50d76e74b821 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1503 microversion: 2.1 time: 0.217303 Jun 22 11:47:28.563966 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 200/355] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:28 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:28.568542 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ca46ddc9-179b-49ba-91e2-cb71107f76e1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:28.569137 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ca46ddc9-179b-49ba-91e2-cb71107f76e1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:28.571794 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 156/356] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:28 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:28.575105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ca46ddc9-179b-49ba-91e2-cb71107f76e1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:28.575574 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ca46ddc9-179b-49ba-91e2-cb71107f76e1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:28.576365 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ca46ddc9-179b-49ba-91e2-cb71107f76e1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:28.576791 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ca46ddc9-179b-49ba-91e2-cb71107f76e1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:28.715878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ca46ddc9-179b-49ba-91e2-cb71107f76e1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:28.724305 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ca46ddc9-179b-49ba-91e2-cb71107f76e1 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.159312 Jun 22 11:47:28.724892 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 201/357] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:28 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:29.582903 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-46cb676a-3579-487e-8431-8bea1986882b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:29.582903 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-46cb676a-3579-487e-8431-8bea1986882b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:29.587473 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:29.588079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:29.588995 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-46cb676a-3579-487e-8431-8bea1986882b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:29.589873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-46cb676a-3579-487e-8431-8bea1986882b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:29.590099 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-46cb676a-3579-487e-8431-8bea1986882b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:29.590476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-46cb676a-3579-487e-8431-8bea1986882b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:29.596360 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:29.596812 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:29.598407 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:29.598766 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:29.915550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-46cb676a-3579-487e-8431-8bea1986882b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:29.923730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:29.925038 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-46cb676a-3579-487e-8431-8bea1986882b tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1503 microversion: 2.1 time: 0.347009 Jun 22 11:47:29.925837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 202/358] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:29 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:29.950219 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0775768d-4238-4af3-9be4-14ce2c603e52 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:29.953131 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:29.953827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0775768d-4238-4af3-9be4-14ce2c603e52 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:29.955392 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:29.956813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-68f7edd7-1731-4ed8-b34d-4d40a333599a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1407 microversion: 2.20 time: 0.381412 Jun 22 11:47:29.957543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 157/359] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:29 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:47:29.966289 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0775768d-4238-4af3-9be4-14ce2c603e52 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:29.966289 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0775768d-4238-4af3-9be4-14ce2c603e52 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:29.966289 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0775768d-4238-4af3-9be4-14ce2c603e52 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:29.966289 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0775768d-4238-4af3-9be4-14ce2c603e52 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:30.199986 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0775768d-4238-4af3-9be4-14ce2c603e52 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:30.217094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0775768d-4238-4af3-9be4-14ce2c603e52 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.276611 Jun 22 11:47:30.218535 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 203/360] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:29 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:30.362314 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-7035dc10-8777-4af7-9945-f542fc48c4f6 req-8262a6e0-a718-49d7-a73b-3e1ba791fb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a02ae69-7dd2-492d-883b-5d0be07889a6", "name": "network-vif-deleted", "tag": "19b98890-f86b-425f-a5fa-2857001a8214"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:30.376282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-7035dc10-8777-4af7-9945-f542fc48c4f6 req-8262a6e0-a718-49d7-a73b-3e1ba791fb41 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:30.376721 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-7035dc10-8777-4af7-9945-f542fc48c4f6 req-8262a6e0-a718-49d7-a73b-3e1ba791fb41 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:30.392455 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-7035dc10-8777-4af7-9945-f542fc48c4f6 req-8262a6e0-a718-49d7-a73b-3e1ba791fb41 service nova] Creating event network-vif-deleted:19b98890-f86b-425f-a5fa-2857001a8214 for instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 on hv-cinder-83697 Jun 22 11:47:30.397478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-7035dc10-8777-4af7-9945-f542fc48c4f6 req-8262a6e0-a718-49d7-a73b-3e1ba791fb41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039563 Jun 22 11:47:30.398077 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 158/361] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:47:30.949657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:30.950466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:30.958227 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:30.958227 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:30.959034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:30.959588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:30.977495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:30.978989 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:30.987885 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:30.988732 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:30.990287 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:30.991622 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:30.996571 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:30.997010 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:30.997450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lazy-loading 'fault' on Instance uuid 9a02ae69-7dd2-492d-883b-5d0be07889a6 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:47:31.045087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:31.054118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0f13e3cf-efee-489e-9085-fd1053fbf974 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1303 microversion: 2.1 time: 0.115592 Jun 22 11:47:31.054484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 204/362] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:30 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:31.143167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:31.151141 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:31.152674 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:31.153811 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-48fdb961-56f9-4256-9179-1886434a81dc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1599 microversion: 2.20 time: 0.181455 Jun 22 11:47:31.154422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 159/363] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:47:30 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1599 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:47:31.171537 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-99262b88-3a34-41af-a06e-2e5d2ec1cc4b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:31.172135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-99262b88-3a34-41af-a06e-2e5d2ec1cc4b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:31.178321 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-99262b88-3a34-41af-a06e-2e5d2ec1cc4b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:31.178792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-99262b88-3a34-41af-a06e-2e5d2ec1cc4b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:31.179650 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-99262b88-3a34-41af-a06e-2e5d2ec1cc4b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:31.180186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-99262b88-3a34-41af-a06e-2e5d2ec1cc4b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:31.234551 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0a7cbfff-ff0e-4e5d-850e-96841ac6cff5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:31.235475 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0a7cbfff-ff0e-4e5d-850e-96841ac6cff5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:31.241934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a7cbfff-ff0e-4e5d-850e-96841ac6cff5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:31.242616 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a7cbfff-ff0e-4e5d-850e-96841ac6cff5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:31.243494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a7cbfff-ff0e-4e5d-850e-96841ac6cff5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:31.270637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a7cbfff-ff0e-4e5d-850e-96841ac6cff5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:31.283261 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-99262b88-3a34-41af-a06e-2e5d2ec1cc4b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115617 Jun 22 11:47:31.284079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 205/364] 10.222.0.36 () {60 vars in 1315 bytes} [Wed Jun 22 11:47:31 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:47:31.573138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0a7cbfff-ff0e-4e5d-850e-96841ac6cff5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:31.588073 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0a7cbfff-ff0e-4e5d-850e-96841ac6cff5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.356056 Jun 22 11:47:31.590439 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 160/365] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:31 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:47:32.071457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:32.073796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:32.081417 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:32.082080 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:32.083029 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:32.083564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:32.115141 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:32.115932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:32.116509 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lazy-loading 'fault' on Instance uuid 9a02ae69-7dd2-492d-883b-5d0be07889a6 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:47:32.168035 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72365998f1bb459cbff28ca0b267fe69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d7e536c4254f469c6da669481eb8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:32.176837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0c5a1ccf-73e6-4d67-b7ce-4baffae4e89e tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 200 len: 1303 microversion: 2.1 time: 0.109963 Jun 22 11:47:32.177602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 206/366] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:32 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:32.552308 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-5cf5a0a5-5e01-4190-9fe4-1effbcf5c70e req-3b801d56-94d4-405c-b41e-08e02ef72ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b85599-217c-4d95-a8ef-136d2368cf70", "tag": "4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:32.561007 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-5cf5a0a5-5e01-4190-9fe4-1effbcf5c70e req-3b801d56-94d4-405c-b41e-08e02ef72ee1 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:32.561832 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-5cf5a0a5-5e01-4190-9fe4-1effbcf5c70e req-3b801d56-94d4-405c-b41e-08e02ef72ee1 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:32.574529 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-5cf5a0a5-5e01-4190-9fe4-1effbcf5c70e req-3b801d56-94d4-405c-b41e-08e02ef72ee1 service nova] Creating event network-changed:4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6 for instance f5b85599-217c-4d95-a8ef-136d2368cf70 on hv-cinder-83697 Jun 22 11:47:32.582979 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-5cf5a0a5-5e01-4190-9fe4-1effbcf5c70e req-3b801d56-94d4-405c-b41e-08e02ef72ee1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 Jun 22 11:47:32.584173 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 161/367] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:47:32.609420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b13bf6f0-8f1f-45a7-8825-a20e858fed2c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:32.610231 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b13bf6f0-8f1f-45a7-8825-a20e858fed2c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:32.618749 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b13bf6f0-8f1f-45a7-8825-a20e858fed2c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:32.620847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b13bf6f0-8f1f-45a7-8825-a20e858fed2c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:32.621741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b13bf6f0-8f1f-45a7-8825-a20e858fed2c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:32.622176 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b13bf6f0-8f1f-45a7-8825-a20e858fed2c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:32.643393 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:32.781833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b13bf6f0-8f1f-45a7-8825-a20e858fed2c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:32.789515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b13bf6f0-8f1f-45a7-8825-a20e858fed2c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.186602 Jun 22 11:47:32.790119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 207/368] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:32 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:33.198246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:33.201741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] [instance: 9a02ae69-7dd2-492d-883b-5d0be07889a6] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:33.214682 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:33.215760 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:33.216645 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:33.218202 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:33.236048 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] HTTP exception thrown: Instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 could not be found. Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Request method failure captured: Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 HTTP/1.1 Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswD8Pv34pvmtY6M41As65rWvlSpIcl5sfgnkOFealMKYePb8l7bMbJpokHcjs1RlMZQkmxNz1vdFY6iUEkIaqk8JDMkV8spt25O1UoXXiubHJslUnAxUg_Fs3L-MCtZupv3xnmqtgFa0VG1nvjqRLhfcEvqCgaD_Zctyxty4q-ckFok Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 97d7e536c4254f469c6da669481eb8e6 Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-VolumesActionsTest-207689026 Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:47:33.237792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/97d7e536c4254f469c6da669481eb8e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/97d7e536c4254f469c6da669481eb8e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_97d7e536c4254f469c6da669481eb8e6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/97d7e536c4254f469c6da669481eb8e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-VolumesActionsTest-207689026 Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 97d7e536c4254f469c6da669481eb8e6 Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-VolumesActionsTest-207689026 Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-VolumesActionsTest-207689026-project Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 72365998f1bb459cbff28ca0b267fe69 Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-VolumesActionsTest-207689026-project Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 could not be found. Jun 22 11:47:33.239295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '9a02ae69-7dd2-492d-883b-5d0be07889a6'} Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 could not be found. Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:47:33.240184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 could not be found. Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 could not be found. Jun 22 11:47:33.241537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:33.242738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] Returning 404 to user: Instance 9a02ae69-7dd2-492d-883b-5d0be07889a6 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:47:33.242738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f38f90bd-9067-4551-b087-2344b19eddc7 tempest-VolumesActionsTest-207689026 tempest-VolumesActionsTest-207689026-project] 10.222.0.36 "GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6" status: 404 len: 111 microversion: 2.1 time: 0.048774 Jun 22 11:47:33.243575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 162/369] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:33 2022] GET /compute/v2.1/servers/9a02ae69-7dd2-492d-883b-5d0be07889a6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:47:33.810932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b812ee53-20e1-4a72-900a-0c476ed11ceb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:33.811928 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b812ee53-20e1-4a72-900a-0c476ed11ceb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:33.821072 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b812ee53-20e1-4a72-900a-0c476ed11ceb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:33.822244 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b812ee53-20e1-4a72-900a-0c476ed11ceb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:33.822547 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b812ee53-20e1-4a72-900a-0c476ed11ceb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:33.823309 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b812ee53-20e1-4a72-900a-0c476ed11ceb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:34.030378 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b812ee53-20e1-4a72-900a-0c476ed11ceb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:34.082936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b812ee53-20e1-4a72-900a-0c476ed11ceb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.276705 Jun 22 11:47:34.086455 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 208/370] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:33 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:35.103579 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-da1523bd-4a5a-465a-853a-62012f328849 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:35.104966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-da1523bd-4a5a-465a-853a-62012f328849 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:35.112678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da1523bd-4a5a-465a-853a-62012f328849 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:35.113119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da1523bd-4a5a-465a-853a-62012f328849 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:35.113871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da1523bd-4a5a-465a-853a-62012f328849 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:35.114473 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da1523bd-4a5a-465a-853a-62012f328849 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:35.287877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-da1523bd-4a5a-465a-853a-62012f328849 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:35.296230 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-da1523bd-4a5a-465a-853a-62012f328849 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.197128 Jun 22 11:47:35.296801 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 163/371] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:35 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:36.324721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-77c9449f-ad0a-4943-a3c2-2eedb0f3fb8f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:36.329255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-77c9449f-ad0a-4943-a3c2-2eedb0f3fb8f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:36.336647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-77c9449f-ad0a-4943-a3c2-2eedb0f3fb8f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:36.338316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-77c9449f-ad0a-4943-a3c2-2eedb0f3fb8f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:36.339786 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-77c9449f-ad0a-4943-a3c2-2eedb0f3fb8f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:36.340560 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-77c9449f-ad0a-4943-a3c2-2eedb0f3fb8f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:36.583721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-77c9449f-ad0a-4943-a3c2-2eedb0f3fb8f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:36.592294 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-77c9449f-ad0a-4943-a3c2-2eedb0f3fb8f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1502 microversion: 2.1 time: 0.282211 Jun 22 11:47:36.603337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 209/372] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:36 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:36.610012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af4ae0c5-995c-40c6-93a4-86fe8e07a170"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:36.611405 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:36.618190 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:36.618761 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:36.619718 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:36.620409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:36.648153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] HTTP exception thrown: Cannot 'attach_volume' instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 while it is in vm_state rescued Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Request method failure captured: Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: POST /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8/os-volume_attachments HTTP/1.1 Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 74 Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswDQxWzIxo8L5QrqUkiWxFb74S_4r3NBQOJ4hKUuQsgRXMFyN-xWyQGiIP0dyUdqvS5aykt2GDDGJWzhMBWy1CiaPbE9Ss9zKyf_rUf2kDN7EST2rbUklHXeBv05p1XtQ6cRoUK9eZw2b2e4Lejk_iT-ELbafxVWciapxpL1eJB2NUo Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:47:36.650090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20536d2fa444e97b7184c10e52d5cc5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 27cc3d38926f470c91eeb6aecfc86a48 Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {"volumeAttachment": {"volumeId": "af4ae0c5-995c-40c6-93a4-86fe8e07a170"}} Jun 22 11:47:36.651678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Cannot 'attach_volume' instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 while it is in vm_state rescued Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'server_id': 'bf3c3cce-4dbe-44a3-b2df-7e43078812f8', 'body': {'volumeAttachment': {'volumeId': 'af4ae0c5-995c-40c6-93a4-86fe8e07a170'}}} Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:47:36.652599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 while it is in vm_state rescued Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:47:36.653967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:47:36.655809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:47:36.655809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:47:36.655809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 while it is in vm_state rescued Jun 22 11:47:36.655809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:47:36.655809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Returning 409 to user: Cannot 'attach_volume' instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 while it is in vm_state rescued {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:47:36.655809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b34e3ed8-0034-4a27-b442-71c573a4dea4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046481 Jun 22 11:47:36.655809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 164/373] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 11:47:36 2022] POST /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 11:47:36.662209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-dbec4771-7c8c-46f7-af26-4c28111842aa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:36.662740 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-dbec4771-7c8c-46f7-af26-4c28111842aa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:36.669312 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbec4771-7c8c-46f7-af26-4c28111842aa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:36.669769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbec4771-7c8c-46f7-af26-4c28111842aa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:36.670567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbec4771-7c8c-46f7-af26-4c28111842aa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:36.670998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dbec4771-7c8c-46f7-af26-4c28111842aa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:36.780488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-dbec4771-7c8c-46f7-af26-4c28111842aa tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8/action" status: 202 len: 0 microversion: 2.1 time: 0.121437 Jun 22 11:47:36.781398 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 210/374] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:47:36 2022] POST /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:47:36.789939 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e2ce0aff-a700-4956-9dd9-165dc6b7b093 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:36.790556 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e2ce0aff-a700-4956-9dd9-165dc6b7b093 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:36.797865 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2ce0aff-a700-4956-9dd9-165dc6b7b093 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:36.798584 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2ce0aff-a700-4956-9dd9-165dc6b7b093 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:36.799428 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2ce0aff-a700-4956-9dd9-165dc6b7b093 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:36.800062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2ce0aff-a700-4956-9dd9-165dc6b7b093 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:36.805211 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:37.045477 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e2ce0aff-a700-4956-9dd9-165dc6b7b093 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:37.055613 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e2ce0aff-a700-4956-9dd9-165dc6b7b093 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1510 microversion: 2.1 time: 0.269579 Jun 22 11:47:37.056435 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 165/375] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:36 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:38.074435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6e6bb9c0-5a0e-4ad1-9ff3-4a8d8b79807c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:38.075138 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6e6bb9c0-5a0e-4ad1-9ff3-4a8d8b79807c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:38.081710 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6e6bb9c0-5a0e-4ad1-9ff3-4a8d8b79807c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:38.082479 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6e6bb9c0-5a0e-4ad1-9ff3-4a8d8b79807c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:38.083517 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6e6bb9c0-5a0e-4ad1-9ff3-4a8d8b79807c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:38.084144 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6e6bb9c0-5a0e-4ad1-9ff3-4a8d8b79807c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:38.255659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6e6bb9c0-5a0e-4ad1-9ff3-4a8d8b79807c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:38.267920 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6e6bb9c0-5a0e-4ad1-9ff3-4a8d8b79807c tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1510 microversion: 2.1 time: 0.197782 Jun 22 11:47:38.268684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 211/376] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:38 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:39.287232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-483be6cc-ceda-4c9c-8435-a0c3b8b8a7a3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:39.289068 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-483be6cc-ceda-4c9c-8435-a0c3b8b8a7a3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:39.299084 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-483be6cc-ceda-4c9c-8435-a0c3b8b8a7a3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:39.299800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-483be6cc-ceda-4c9c-8435-a0c3b8b8a7a3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:39.301134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-483be6cc-ceda-4c9c-8435-a0c3b8b8a7a3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:39.301572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-483be6cc-ceda-4c9c-8435-a0c3b8b8a7a3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:39.465029 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-483be6cc-ceda-4c9c-8435-a0c3b8b8a7a3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:39.475021 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-483be6cc-ceda-4c9c-8435-a0c3b8b8a7a3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1510 microversion: 2.1 time: 0.192123 Jun 22 11:47:39.486011 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 166/377] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:39 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:40.492353 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f7f7a1d8-eb86-4294-a14c-aba43136aa08 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:40.493548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f7f7a1d8-eb86-4294-a14c-aba43136aa08 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:40.503263 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f7f7a1d8-eb86-4294-a14c-aba43136aa08 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:40.504806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f7f7a1d8-eb86-4294-a14c-aba43136aa08 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:40.505787 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f7f7a1d8-eb86-4294-a14c-aba43136aa08 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:40.507808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f7f7a1d8-eb86-4294-a14c-aba43136aa08 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:40.842511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f7f7a1d8-eb86-4294-a14c-aba43136aa08 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:40.859134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f7f7a1d8-eb86-4294-a14c-aba43136aa08 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1510 microversion: 2.1 time: 0.370540 Jun 22 11:47:40.860699 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 212/378] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:40 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:41.877860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9ce7dc2e-57ee-4efc-85d7-572dc6d002cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:41.894780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9ce7dc2e-57ee-4efc-85d7-572dc6d002cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:41.925843 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ce7dc2e-57ee-4efc-85d7-572dc6d002cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:41.931687 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ce7dc2e-57ee-4efc-85d7-572dc6d002cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:41.933605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ce7dc2e-57ee-4efc-85d7-572dc6d002cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:41.938060 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ce7dc2e-57ee-4efc-85d7-572dc6d002cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:42.450278 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9ce7dc2e-57ee-4efc-85d7-572dc6d002cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:42.462119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9ce7dc2e-57ee-4efc-85d7-572dc6d002cb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1510 microversion: 2.1 time: 0.588054 Jun 22 11:47:42.473841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 167/379] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:41 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:43.484639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b4c4624e-e207-429d-97e6-abfa6ad4eb04 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:43.486090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b4c4624e-e207-429d-97e6-abfa6ad4eb04 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:43.504418 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4c4624e-e207-429d-97e6-abfa6ad4eb04 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:43.504965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4c4624e-e207-429d-97e6-abfa6ad4eb04 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:43.505844 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4c4624e-e207-429d-97e6-abfa6ad4eb04 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:43.506713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4c4624e-e207-429d-97e6-abfa6ad4eb04 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:43.967030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b4c4624e-e207-429d-97e6-abfa6ad4eb04 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:43.978767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b4c4624e-e207-429d-97e6-abfa6ad4eb04 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1516 microversion: 2.1 time: 0.501546 Jun 22 11:47:43.987085 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 213/380] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:43 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1516 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:45.556408 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b5f8514a-985c-4ed4-a743-a73478797bf3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Action: 'create', calling method: .version_select at 0x7f3ea84bf280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1723268586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPke7/bTMfsXSFBu3jVEUxnsORmL35QENnMN7LhsS64r/gGk7F7juclNrjbemnntuUji86ZyTVPCu7EXo6NJiwjJyDlqJo0A8GjB98B7Pdshl4lOZZlScPCFdBL4SYwcQ=="}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:45.563744 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:45.601573 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-b5f8514a-985c-4ed4-a743-a73478797bf3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Getting quotas for project 4845f1df49c64dcc8c4a48691fae9a27. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:47:45.607097 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-b5f8514a-985c-4ed4-a743-a73478797bf3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Getting quotas for user 58976549233e4bb6991258f7da1123ae and project 4845f1df49c64dcc8c4a48691fae9a27. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:47:45.650900 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b5f8514a-985c-4ed4-a743-a73478797bf3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.529689 Jun 22 11:47:45.651718 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 168/381] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 11:47:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:47:45.879207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1f137bcd-260f-4cec-bee4-550f5a7f211b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'create', calling method: .version_select at 0x7f3ea83d2af0>, body: {"keypair": {"name": "tempest-keypair-437700771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjWvs7vBQ3RyPGgjOA4FSRFkVuUScAN0x7aCI6Ul/kyIL/UGiLJDgFO4hTnyUgKkzXOzE2t5zypKwLHKs+TKmPRELhhBZmdC7QP6w3RXnU2toOPTCNvzNTnFW63l+VwMQ=="}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:45.901655 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-1f137bcd-260f-4cec-bee4-550f5a7f211b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Getting quotas for project d20536d2fa444e97b7184c10e52d5cc5. Resources: {'key_pairs'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:47:45.917345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-1f137bcd-260f-4cec-bee4-550f5a7f211b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Getting quotas for user 27cc3d38926f470c91eeb6aecfc86a48 and project d20536d2fa444e97b7184c10e52d5cc5. Resources: {'key_pairs'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:47:45.982818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1f137bcd-260f-4cec-bee4-550f5a7f211b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106569 Jun 22 11:47:45.984197 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 214/382] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 11:47:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:47:49.709919 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-827605516", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8379a407-3f34-4fda-9b10-2cf8a457f682"}], "security_groups": [{"name": "tempest-securitygroup--200794593"}], "key_name": "tempest-keypair-437700771", "user_data": "}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:50.059666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] validate_networks() for [('8379a407-3f34-4fda-9b10-2cf8a457f682', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:47:51.195153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:47:51.196377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:47:51.197009 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:47:51.197587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:47:51.198160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:47:51.237412 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:51.237862 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:51.238664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:51.239096 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:51.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Getting quotas for project d20536d2fa444e97b7184c10e52d5cc5. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:47:51.302057 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Getting quotas for user 27cc3d38926f470c91eeb6aecfc86a48 and project d20536d2fa444e97b7184c10e52d5cc5. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:47:51.334420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:47:51.337055 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:47:51.453586 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-370d3e3a-6461-4f8e-a265-22a564688d34 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.747995 Jun 22 11:47:51.465233 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e5d6b6aa-50ad-432a-b86c-2d8427db3bbd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:51.466958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e5d6b6aa-50ad-432a-b86c-2d8427db3bbd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:51.472435 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 169/383] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:47:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:47:51.563241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e5d6b6aa-50ad-432a-b86c-2d8427db3bbd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:51.574581 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e5d6b6aa-50ad-432a-b86c-2d8427db3bbd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1244 microversion: 2.1 time: 0.111504 Jun 22 11:47:51.577338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 215/384] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:51 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:52.594128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0930b39a-9343-4cf4-99b0-4e8465d2ed1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:52.596374 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0930b39a-9343-4cf4-99b0-4e8465d2ed1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:52.614621 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0930b39a-9343-4cf4-99b0-4e8465d2ed1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:52.615730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0930b39a-9343-4cf4-99b0-4e8465d2ed1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:52.619018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0930b39a-9343-4cf4-99b0-4e8465d2ed1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:52.619822 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0930b39a-9343-4cf4-99b0-4e8465d2ed1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:52.778251 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0930b39a-9343-4cf4-99b0-4e8465d2ed1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:52.797315 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0930b39a-9343-4cf4-99b0-4e8465d2ed1f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1248 microversion: 2.1 time: 0.207122 Jun 22 11:47:52.825259 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 170/385] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:52 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1248 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:53.827273 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5e24e4d2-8fff-4c06-961e-81a0aa280d46 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:53.828386 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5e24e4d2-8fff-4c06-961e-81a0aa280d46 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:53.852797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:47:53.872845 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5e24e4d2-8fff-4c06-961e-81a0aa280d46 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:53.879162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5e24e4d2-8fff-4c06-961e-81a0aa280d46 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:53.880305 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5e24e4d2-8fff-4c06-961e-81a0aa280d46 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:53.880886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5e24e4d2-8fff-4c06-961e-81a0aa280d46 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:54.078078 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5e24e4d2-8fff-4c06-961e-81a0aa280d46 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:54.089907 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5e24e4d2-8fff-4c06-961e-81a0aa280d46 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1314 microversion: 2.1 time: 0.267864 Jun 22 11:47:54.092552 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 216/386] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:53 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:55.110220 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-40602832-b344-47aa-9adf-5a8ce2314e0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:55.110626 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-40602832-b344-47aa-9adf-5a8ce2314e0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:55.121912 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-40602832-b344-47aa-9adf-5a8ce2314e0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:55.122534 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-40602832-b344-47aa-9adf-5a8ce2314e0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:55.131295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-40602832-b344-47aa-9adf-5a8ce2314e0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:55.134956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-40602832-b344-47aa-9adf-5a8ce2314e0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:55.849058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-40602832-b344-47aa-9adf-5a8ce2314e0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:55.862601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-40602832-b344-47aa-9adf-5a8ce2314e0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.757425 Jun 22 11:47:55.864619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 171/387] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:55 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:56.882755 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-65d32283-dac7-4b0a-829a-94e00a403cc3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:56.888768 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-65d32283-dac7-4b0a-829a-94e00a403cc3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:56.897136 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-65d32283-dac7-4b0a-829a-94e00a403cc3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:56.897861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-65d32283-dac7-4b0a-829a-94e00a403cc3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:56.900246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-65d32283-dac7-4b0a-829a-94e00a403cc3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:56.901777 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-65d32283-dac7-4b0a-829a-94e00a403cc3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:57.420236 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-762f642a-5924-47a4-b6f6-4ca2f7df1df3 req-b35cfb1a-0b11-4172-97f6-79ce18df7df3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917f312d-2bff-4f24-b5ee-5009132047cd", "tag": "18b5b430-c735-4878-a26d-6c754a8d3c06"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:47:57.448556 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-762f642a-5924-47a4-b6f6-4ca2f7df1df3 req-b35cfb1a-0b11-4172-97f6-79ce18df7df3 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:57.450759 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-762f642a-5924-47a4-b6f6-4ca2f7df1df3 req-b35cfb1a-0b11-4172-97f6-79ce18df7df3 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:57.474845 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-762f642a-5924-47a4-b6f6-4ca2f7df1df3 req-b35cfb1a-0b11-4172-97f6-79ce18df7df3 service nova] Creating event network-changed:18b5b430-c735-4878-a26d-6c754a8d3c06 for instance 917f312d-2bff-4f24-b5ee-5009132047cd on hv-cinder-83697 Jun 22 11:47:57.494707 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-762f642a-5924-47a4-b6f6-4ca2f7df1df3 req-b35cfb1a-0b11-4172-97f6-79ce18df7df3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093494 Jun 22 11:47:57.501511 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 172/388] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:47:57.672582 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-65d32283-dac7-4b0a-829a-94e00a403cc3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:57.683334 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-65d32283-dac7-4b0a-829a-94e00a403cc3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.805145 Jun 22 11:47:57.701605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 217/389] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:56 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:47:58.705574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-62321592-b435-4d5a-b284-18b12ddeb60f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:47:58.706572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-62321592-b435-4d5a-b284-18b12ddeb60f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:47:58.723768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62321592-b435-4d5a-b284-18b12ddeb60f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:58.729159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62321592-b435-4d5a-b284-18b12ddeb60f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:58.730076 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62321592-b435-4d5a-b284-18b12ddeb60f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:47:58.730925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62321592-b435-4d5a-b284-18b12ddeb60f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:47:59.348255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-62321592-b435-4d5a-b284-18b12ddeb60f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:47:59.362522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-62321592-b435-4d5a-b284-18b12ddeb60f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.661189 Jun 22 11:47:59.367023 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 173/390] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:47:58 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:00.382530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7c0d2652-bb21-4ccd-9581-e21d1336251d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:00.383797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7c0d2652-bb21-4ccd-9581-e21d1336251d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:00.400524 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7c0d2652-bb21-4ccd-9581-e21d1336251d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:00.401292 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7c0d2652-bb21-4ccd-9581-e21d1336251d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:00.402876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7c0d2652-bb21-4ccd-9581-e21d1336251d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:00.404460 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7c0d2652-bb21-4ccd-9581-e21d1336251d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:00.604747 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7c0d2652-bb21-4ccd-9581-e21d1336251d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:00.616019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7c0d2652-bb21-4ccd-9581-e21d1336251d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.236620 Jun 22 11:48:00.617157 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 218/391] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:00 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:01.637258 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d027083e-020a-4d69-a81a-32bf901d1681 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:01.637894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d027083e-020a-4d69-a81a-32bf901d1681 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:01.643969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:01.644932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=10 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:01.667592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d027083e-020a-4d69-a81a-32bf901d1681 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:01.675520 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d027083e-020a-4d69-a81a-32bf901d1681 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:01.679480 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d027083e-020a-4d69-a81a-32bf901d1681 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:01.679952 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d027083e-020a-4d69-a81a-32bf901d1681 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:01.952470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d027083e-020a-4d69-a81a-32bf901d1681 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:01.961006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d027083e-020a-4d69-a81a-32bf901d1681 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.331338 Jun 22 11:48:01.963294 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 174/392] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:01 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:02.984619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-95e857ef-5c87-4d64-9f94-d4c02378c4ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:02.986306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-95e857ef-5c87-4d64-9f94-d4c02378c4ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:02.993210 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=6 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:02.995814 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-95e857ef-5c87-4d64-9f94-d4c02378c4ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:02.996652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-95e857ef-5c87-4d64-9f94-d4c02378c4ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:02.997698 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-95e857ef-5c87-4d64-9f94-d4c02378c4ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:02.998325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-95e857ef-5c87-4d64-9f94-d4c02378c4ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:03.006049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:03.215236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-95e857ef-5c87-4d64-9f94-d4c02378c4ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:03.224974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-95e857ef-5c87-4d64-9f94-d4c02378c4ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.246822 Jun 22 11:48:03.226142 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 219/393] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:02 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:04.242253 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a8063bd4-424a-4ce5-a765-f36c17a275a2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:04.243669 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a8063bd4-424a-4ce5-a765-f36c17a275a2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:04.256623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a8063bd4-424a-4ce5-a765-f36c17a275a2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:04.257420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a8063bd4-424a-4ce5-a765-f36c17a275a2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:04.258541 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a8063bd4-424a-4ce5-a765-f36c17a275a2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:04.258875 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a8063bd4-424a-4ce5-a765-f36c17a275a2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:04.450688 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a8063bd4-424a-4ce5-a765-f36c17a275a2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:04.458949 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a8063bd4-424a-4ce5-a765-f36c17a275a2 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.220715 Jun 22 11:48:04.459588 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 175/394] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:04 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:05.483673 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-aa5ab778-139d-4d97-a2f4-e0f1e3b5afe5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:05.484293 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-aa5ab778-139d-4d97-a2f4-e0f1e3b5afe5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:05.490645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa5ab778-139d-4d97-a2f4-e0f1e3b5afe5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:05.491316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa5ab778-139d-4d97-a2f4-e0f1e3b5afe5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:05.492121 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa5ab778-139d-4d97-a2f4-e0f1e3b5afe5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:05.492561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa5ab778-139d-4d97-a2f4-e0f1e3b5afe5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:05.662518 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aa5ab778-139d-4d97-a2f4-e0f1e3b5afe5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:05.672962 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-aa5ab778-139d-4d97-a2f4-e0f1e3b5afe5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.194466 Jun 22 11:48:05.673907 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 220/395] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:05 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:06.695694 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-56ac7e79-fc95-4b98-8257-04b426bef593 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:06.697871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-56ac7e79-fc95-4b98-8257-04b426bef593 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:06.709620 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-56ac7e79-fc95-4b98-8257-04b426bef593 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:06.710200 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-56ac7e79-fc95-4b98-8257-04b426bef593 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:06.711463 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-56ac7e79-fc95-4b98-8257-04b426bef593 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:06.712771 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-56ac7e79-fc95-4b98-8257-04b426bef593 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:07.030342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-56ac7e79-fc95-4b98-8257-04b426bef593 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:07.036961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=55 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:07.041128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-56ac7e79-fc95-4b98-8257-04b426bef593 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.352480 Jun 22 11:48:07.042273 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 176/396] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:06 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:08.060203 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-96cdd24a-4bf0-43a0-941d-bce296414fc0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:08.061977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-96cdd24a-4bf0-43a0-941d-bce296414fc0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:08.072010 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-96cdd24a-4bf0-43a0-941d-bce296414fc0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:08.074003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-96cdd24a-4bf0-43a0-941d-bce296414fc0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:08.075650 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-96cdd24a-4bf0-43a0-941d-bce296414fc0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:08.076534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-96cdd24a-4bf0-43a0-941d-bce296414fc0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:08.268778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-96cdd24a-4bf0-43a0-941d-bce296414fc0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:08.281289 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-96cdd24a-4bf0-43a0-941d-bce296414fc0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.225478 Jun 22 11:48:08.282481 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 221/397] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:08 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:09.348601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d9b0f6b4-56a6-457a-8908-8b192ac5f2fe tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:09.349815 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d9b0f6b4-56a6-457a-8908-8b192ac5f2fe tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:09.367701 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9b0f6b4-56a6-457a-8908-8b192ac5f2fe tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:09.368431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9b0f6b4-56a6-457a-8908-8b192ac5f2fe tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:09.369383 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9b0f6b4-56a6-457a-8908-8b192ac5f2fe tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:09.369978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9b0f6b4-56a6-457a-8908-8b192ac5f2fe tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:09.546846 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d9b0f6b4-56a6-457a-8908-8b192ac5f2fe tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:09.557044 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d9b0f6b4-56a6-457a-8908-8b192ac5f2fe tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.214740 Jun 22 11:48:09.567938 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 177/398] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:09 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:10.573843 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-aab67d8b-c2a7-4486-92f0-62f3408cc72f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:10.575830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-aab67d8b-c2a7-4486-92f0-62f3408cc72f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:10.585291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aab67d8b-c2a7-4486-92f0-62f3408cc72f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:10.585904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aab67d8b-c2a7-4486-92f0-62f3408cc72f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:10.586688 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aab67d8b-c2a7-4486-92f0-62f3408cc72f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:10.587238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aab67d8b-c2a7-4486-92f0-62f3408cc72f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:10.734135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aab67d8b-c2a7-4486-92f0-62f3408cc72f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:10.745200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-aab67d8b-c2a7-4486-92f0-62f3408cc72f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.174995 Jun 22 11:48:10.745905 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 222/399] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:10 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:11.765518 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-38eed1e8-32cc-4e1d-aa67-e7e7d332d0f5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:11.766971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-38eed1e8-32cc-4e1d-aa67-e7e7d332d0f5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:11.774021 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-38eed1e8-32cc-4e1d-aa67-e7e7d332d0f5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:11.774811 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-38eed1e8-32cc-4e1d-aa67-e7e7d332d0f5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:11.777169 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-38eed1e8-32cc-4e1d-aa67-e7e7d332d0f5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:11.777594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-38eed1e8-32cc-4e1d-aa67-e7e7d332d0f5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:11.948149 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-38eed1e8-32cc-4e1d-aa67-e7e7d332d0f5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:11.958417 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-38eed1e8-32cc-4e1d-aa67-e7e7d332d0f5 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.197157 Jun 22 11:48:11.958912 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 178/400] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:11 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:12.977834 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-db7ebb5a-876e-4f5c-93c1-e148df214646 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:12.979073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-db7ebb5a-876e-4f5c-93c1-e148df214646 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:12.985149 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db7ebb5a-876e-4f5c-93c1-e148df214646 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:12.985857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db7ebb5a-876e-4f5c-93c1-e148df214646 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:12.986853 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db7ebb5a-876e-4f5c-93c1-e148df214646 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:12.987532 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db7ebb5a-876e-4f5c-93c1-e148df214646 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:13.165160 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-db7ebb5a-876e-4f5c-93c1-e148df214646 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:13.178597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-db7ebb5a-876e-4f5c-93c1-e148df214646 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.206541 Jun 22 11:48:13.189467 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 223/401] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:12 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:13.566587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-6da4f62e-ed31-4335-8891-df5b409ebaad req-20173abe-1922-4f82-ae88-c08024ccd768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917f312d-2bff-4f24-b5ee-5009132047cd", "name": "network-vif-plugged", "status": "completed", "tag": "18b5b430-c735-4878-a26d-6c754a8d3c06"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:13.593445 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-6da4f62e-ed31-4335-8891-df5b409ebaad req-20173abe-1922-4f82-ae88-c08024ccd768 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:13.594902 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-6da4f62e-ed31-4335-8891-df5b409ebaad req-20173abe-1922-4f82-ae88-c08024ccd768 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:13.625489 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-6da4f62e-ed31-4335-8891-df5b409ebaad req-20173abe-1922-4f82-ae88-c08024ccd768 service nova] Creating event network-vif-plugged:18b5b430-c735-4878-a26d-6c754a8d3c06 for instance 917f312d-2bff-4f24-b5ee-5009132047cd on hv-cinder-83697 Jun 22 11:48:13.638012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-6da4f62e-ed31-4335-8891-df5b409ebaad req-20173abe-1922-4f82-ae88-c08024ccd768 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078549 Jun 22 11:48:13.641953 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 179/402] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:48:14.196725 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9d9f376e-8cea-4561-a473-e2a40a80d74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:14.196725 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9d9f376e-8cea-4561-a473-e2a40a80d74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:14.220078 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9d9f376e-8cea-4561-a473-e2a40a80d74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:14.223422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9d9f376e-8cea-4561-a473-e2a40a80d74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:14.223422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9d9f376e-8cea-4561-a473-e2a40a80d74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:14.223422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9d9f376e-8cea-4561-a473-e2a40a80d74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:14.458978 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9d9f376e-8cea-4561-a473-e2a40a80d74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:14.468792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9d9f376e-8cea-4561-a473-e2a40a80d74a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.276573 Jun 22 11:48:14.469654 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 224/403] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:14 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:15.493258 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-86c683cb-fc86-4c96-9052-4d3e27907fbb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:15.495541 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-86c683cb-fc86-4c96-9052-4d3e27907fbb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:15.504774 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-86c683cb-fc86-4c96-9052-4d3e27907fbb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:15.505545 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-86c683cb-fc86-4c96-9052-4d3e27907fbb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:15.506814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-86c683cb-fc86-4c96-9052-4d3e27907fbb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:15.507413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-86c683cb-fc86-4c96-9052-4d3e27907fbb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:15.680719 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-86c683cb-fc86-4c96-9052-4d3e27907fbb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:15.689514 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-86c683cb-fc86-4c96-9052-4d3e27907fbb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.204198 Jun 22 11:48:15.692429 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 180/404] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:15 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:16.708380 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-04708081-aa87-40f5-8110-d4d590edf58b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:16.708990 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-04708081-aa87-40f5-8110-d4d590edf58b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:16.715776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04708081-aa87-40f5-8110-d4d590edf58b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:16.716726 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04708081-aa87-40f5-8110-d4d590edf58b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:16.717763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04708081-aa87-40f5-8110-d4d590edf58b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:16.718430 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04708081-aa87-40f5-8110-d4d590edf58b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:16.889288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-04708081-aa87-40f5-8110-d4d590edf58b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:16.900054 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-04708081-aa87-40f5-8110-d4d590edf58b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1369 microversion: 2.1 time: 0.195350 Jun 22 11:48:16.901254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 225/405] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:16 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:17.817140 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-44ba6d75-673f-4221-8e51-03088946eaf9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Action: 'create', calling method: .version_select at 0x7f3ea832b550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1624224970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6f/MCNyPeGc8HxcGGDlL2RS8G1isDUGndhyLQEbHoJLB3ZCe3p/MvMNxCq2qPe/CpY7rQm3t1vsCJe3Q2Sbz3mXEVyRx4IfFWuTdp8BUV5BOju1MuLo6V1xs6M0pKcuA=="}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:17.821619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:17.834174 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-44ba6d75-673f-4221-8e51-03088946eaf9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Getting quotas for project 2975e2c648284a80824126eecc5d0269. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:48:17.838758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-44ba6d75-673f-4221-8e51-03088946eaf9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Getting quotas for user 8fc6cd29af4d4c28bec9bf6cc9db5749 and project 2975e2c648284a80824126eecc5d0269. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:48:17.861612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-44ba6d75-673f-4221-8e51-03088946eaf9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048684 Jun 22 11:48:17.862211 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 181/406] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 11:48:17 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:48:17.920746 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-596df497-e2cd-4aa5-a81f-a98b99692bbf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:17.921429 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-596df497-e2cd-4aa5-a81f-a98b99692bbf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:17.928567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-596df497-e2cd-4aa5-a81f-a98b99692bbf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:17.929019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-596df497-e2cd-4aa5-a81f-a98b99692bbf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:17.929833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-596df497-e2cd-4aa5-a81f-a98b99692bbf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:17.930273 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-596df497-e2cd-4aa5-a81f-a98b99692bbf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:17.966216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1383777100", "imageRef": "dd4b1f88-7298-41b2-b0e3-6e5b788f54c5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1624224970", "networks": [{"uuid": "af0dd06e-de1a-46dc-a96b-6ab64b1f76cc"}]}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:18.026086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] validate_networks() for [('af0dd06e-de1a-46dc-a96b-6ab64b1f76cc', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:48:18.147840 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-596df497-e2cd-4aa5-a81f-a98b99692bbf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:18.156145 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-596df497-e2cd-4aa5-a81f-a98b99692bbf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1563 microversion: 2.1 time: 0.240179 Jun 22 11:48:18.156773 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 226/407] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:17 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:18.173721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2b9563ed-3fa8-4bff-9ed9-3840e416948b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:18.174132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2b9563ed-3fa8-4bff-9ed9-3840e416948b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:18.180345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2b9563ed-3fa8-4bff-9ed9-3840e416948b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:18.180785 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2b9563ed-3fa8-4bff-9ed9-3840e416948b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:18.181536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2b9563ed-3fa8-4bff-9ed9-3840e416948b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:18.182182 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2b9563ed-3fa8-4bff-9ed9-3840e416948b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:18.302318 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2b9563ed-3fa8-4bff-9ed9-3840e416948b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133644 Jun 22 11:48:18.302926 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 227/408] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 11:48:18 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:48:18.509711 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:48:18.510127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:48:18.510602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:48:18.511097 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:48:18.511537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:48:18.521354 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:18.521791 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:18.522585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:18.523006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:18.542209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Getting quotas for project 2975e2c648284a80824126eecc5d0269. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:48:18.547001 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Getting quotas for user 8fc6cd29af4d4c28bec9bf6cc9db5749 and project 2975e2c648284a80824126eecc5d0269. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:48:18.559412 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:48:18.561620 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd4b1f88-7298-41b2-b0e3-6e5b788f54c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:48:18.614486 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-611837a4-7960-4c8d-8b57-96f7b288d461 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652017 Jun 22 11:48:18.615141 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 182/409] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:48:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 11:48:18.625239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-466ecb28-fd21-4c99-9807-8aee8ca95a76 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:18.626106 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-466ecb28-fd21-4c99-9807-8aee8ca95a76 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:18.683091 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-466ecb28-fd21-4c99-9807-8aee8ca95a76 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:18.691912 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-466ecb28-fd21-4c99-9807-8aee8ca95a76 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1259 microversion: 2.1 time: 0.070476 Jun 22 11:48:18.692978 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 228/410] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:18 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:19.711272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b801f2b9-1a70-48a5-987e-100a892a549b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:19.712063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b801f2b9-1a70-48a5-987e-100a892a549b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:19.712845 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-134278f3-9182-4c31-92d9-203e7febe38f req-07a1c599-0f0a-4670-8c05-bd0cff0b43f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917f312d-2bff-4f24-b5ee-5009132047cd", "tag": "18b5b430-c735-4878-a26d-6c754a8d3c06"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:19.720215 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b801f2b9-1a70-48a5-987e-100a892a549b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:19.720808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b801f2b9-1a70-48a5-987e-100a892a549b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:19.721393 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-134278f3-9182-4c31-92d9-203e7febe38f req-07a1c599-0f0a-4670-8c05-bd0cff0b43f3 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:19.721762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b801f2b9-1a70-48a5-987e-100a892a549b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:19.721863 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-134278f3-9182-4c31-92d9-203e7febe38f req-07a1c599-0f0a-4670-8c05-bd0cff0b43f3 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:19.722395 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b801f2b9-1a70-48a5-987e-100a892a549b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:19.735058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-134278f3-9182-4c31-92d9-203e7febe38f req-07a1c599-0f0a-4670-8c05-bd0cff0b43f3 service nova] Creating event network-changed:18b5b430-c735-4878-a26d-6c754a8d3c06 for instance 917f312d-2bff-4f24-b5ee-5009132047cd on hv-cinder-83697 Jun 22 11:48:19.740273 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-134278f3-9182-4c31-92d9-203e7febe38f req-07a1c599-0f0a-4670-8c05-bd0cff0b43f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031421 Jun 22 11:48:19.741108 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 229/411] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:48:19.792324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b801f2b9-1a70-48a5-987e-100a892a549b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:19.800284 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b801f2b9-1a70-48a5-987e-100a892a549b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1311 microversion: 2.1 time: 0.092887 Jun 22 11:48:19.801051 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 183/412] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:19 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:20.818341 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d5869319-d608-4a68-ac8f-f0bcf0f4cc6e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:20.819041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d5869319-d608-4a68-ac8f-f0bcf0f4cc6e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:20.836424 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d5869319-d608-4a68-ac8f-f0bcf0f4cc6e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:20.837134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d5869319-d608-4a68-ac8f-f0bcf0f4cc6e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:20.838254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d5869319-d608-4a68-ac8f-f0bcf0f4cc6e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:20.838861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d5869319-d608-4a68-ac8f-f0bcf0f4cc6e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:20.915520 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d5869319-d608-4a68-ac8f-f0bcf0f4cc6e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:20.924635 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d5869319-d608-4a68-ac8f-f0bcf0f4cc6e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1317 microversion: 2.1 time: 0.110447 Jun 22 11:48:20.935773 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 230/413] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:20 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1317 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:21.942778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-232751f0-fe78-4b2b-b8eb-e368ae6cc250 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:21.943465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-232751f0-fe78-4b2b-b8eb-e368ae6cc250 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:21.951222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-232751f0-fe78-4b2b-b8eb-e368ae6cc250 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:21.951696 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-232751f0-fe78-4b2b-b8eb-e368ae6cc250 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:21.952525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-232751f0-fe78-4b2b-b8eb-e368ae6cc250 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:21.952881 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-232751f0-fe78-4b2b-b8eb-e368ae6cc250 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:22.096224 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-232751f0-fe78-4b2b-b8eb-e368ae6cc250 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:22.103996 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-232751f0-fe78-4b2b-b8eb-e368ae6cc250 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.165088 Jun 22 11:48:22.104575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 184/414] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:21 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:23.122661 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1d89ba38-752c-499f-846c-603376cfec59 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:23.123539 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1d89ba38-752c-499f-846c-603376cfec59 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:23.130424 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1d89ba38-752c-499f-846c-603376cfec59 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:23.130878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1d89ba38-752c-499f-846c-603376cfec59 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:23.131769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1d89ba38-752c-499f-846c-603376cfec59 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:23.132200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1d89ba38-752c-499f-846c-603376cfec59 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:23.275310 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1d89ba38-752c-499f-846c-603376cfec59 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:23.286004 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1d89ba38-752c-499f-846c-603376cfec59 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.167393 Jun 22 11:48:23.286999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 231/415] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:23 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:24.304454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-de1f24b4-c2fe-4fac-bed7-843a2e01d072 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:24.305037 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-de1f24b4-c2fe-4fac-bed7-843a2e01d072 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:24.312293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de1f24b4-c2fe-4fac-bed7-843a2e01d072 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:24.312853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de1f24b4-c2fe-4fac-bed7-843a2e01d072 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:24.313720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de1f24b4-c2fe-4fac-bed7-843a2e01d072 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:24.314304 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de1f24b4-c2fe-4fac-bed7-843a2e01d072 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:24.453247 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-de1f24b4-c2fe-4fac-bed7-843a2e01d072 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:24.461128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-de1f24b4-c2fe-4fac-bed7-843a2e01d072 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.160569 Jun 22 11:48:24.461687 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 185/416] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:24 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:25.169377 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-738716149", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1723268586", "security_groups": [{"name": "tempest-secgroup-smoke-1710818290"}], "networks": [{"uuid": "4e55a216-be98-4cec-bf48-02c210486373"}], "block_device_mapping_v2": [{"uuid": "7edd5192-a245-45d1-9f8e-e2c424fd9e02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:25.179212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=34 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:25.302509 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] validate_networks() for [('4e55a216-be98-4cec-bf48-02c210486373', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:48:25.478156 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-54c5e6f9-b413-467b-b0b2-86743d00d44c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:25.478918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-54c5e6f9-b413-467b-b0b2-86743d00d44c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:25.488109 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-54c5e6f9-b413-467b-b0b2-86743d00d44c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:25.488552 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-54c5e6f9-b413-467b-b0b2-86743d00d44c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:25.489317 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-54c5e6f9-b413-467b-b0b2-86743d00d44c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:25.489746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-54c5e6f9-b413-467b-b0b2-86743d00d44c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:25.709358 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-54c5e6f9-b413-467b-b0b2-86743d00d44c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:25.721870 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-54c5e6f9-b413-467b-b0b2-86743d00d44c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.247437 Jun 22 11:48:25.722451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 186/417] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:25 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:25.815363 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:48:25.815768 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:48:25.816230 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:48:25.816654 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:48:25.817067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:48:25.826552 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:25.827025 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:25.827959 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:25.828387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:25.855070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Getting quotas for project 4845f1df49c64dcc8c4a48691fae9a27. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:48:25.859608 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Getting quotas for user 58976549233e4bb6991258f7da1123ae and project 4845f1df49c64dcc8c4a48691fae9a27. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:48:25.923117 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:48:25.925326 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7edd5192-a245-45d1-9f8e-e2c424fd9e02',volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:48:26.063622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [8d72f8c2-dd5f-4743-9736-a49c2ced87b8] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 11:48:26.738061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6e3810ea-ecbc-436e-b542-3881ddaa030c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:26.738948 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6e3810ea-ecbc-436e-b542-3881ddaa030c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:26.745138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e3810ea-ecbc-436e-b542-3881ddaa030c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:26.745574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e3810ea-ecbc-436e-b542-3881ddaa030c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:26.746362 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e3810ea-ecbc-436e-b542-3881ddaa030c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:26.746780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e3810ea-ecbc-436e-b542-3881ddaa030c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:26.888889 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6e3810ea-ecbc-436e-b542-3881ddaa030c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:26.897452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6e3810ea-ecbc-436e-b542-3881ddaa030c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.163095 Jun 22 11:48:26.898442 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 187/418] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:26 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:27.070948 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [8d72f8c2-dd5f-4743-9736-a49c2ced87b8] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48306. Jun 22 11:48:27.075941 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ffe5e04e-5eaa-4ac9-9188-1639c9b2a9e0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.911025 Jun 22 11:48:27.082013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 232/419] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:48:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:48:27.086782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fef3e981-9689-48e4-a9e2-61874cab965c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:27.087621 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-fef3e981-9689-48e4-a9e2-61874cab965c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:27.146953 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fef3e981-9689-48e4-a9e2-61874cab965c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:27.155948 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-fef3e981-9689-48e4-a9e2-61874cab965c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1088 microversion: 2.1 time: 0.072851 Jun 22 11:48:27.156519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 188/420] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:27 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:27.915932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bde61f85-25ef-417d-a30f-ec69dc348529 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:27.916535 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bde61f85-25ef-417d-a30f-ec69dc348529 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:27.923492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bde61f85-25ef-417d-a30f-ec69dc348529 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:27.923937 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bde61f85-25ef-417d-a30f-ec69dc348529 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:27.924700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bde61f85-25ef-417d-a30f-ec69dc348529 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:27.925602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bde61f85-25ef-417d-a30f-ec69dc348529 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:28.102838 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bde61f85-25ef-417d-a30f-ec69dc348529 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:28.111676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bde61f85-25ef-417d-a30f-ec69dc348529 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.199697 Jun 22 11:48:28.112242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 233/421] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:27 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:28.172983 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7e8de121-bac3-4564-802c-a7bdb3e153c2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:28.173563 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7e8de121-bac3-4564-802c-a7bdb3e153c2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:28.180154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e8de121-bac3-4564-802c-a7bdb3e153c2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:28.180594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e8de121-bac3-4564-802c-a7bdb3e153c2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:28.181342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e8de121-bac3-4564-802c-a7bdb3e153c2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:28.181772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e8de121-bac3-4564-802c-a7bdb3e153c2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:28.246277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7e8de121-bac3-4564-802c-a7bdb3e153c2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:28.254526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7e8de121-bac3-4564-802c-a7bdb3e153c2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.085376 Jun 22 11:48:28.255407 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 189/422] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:28 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:29.131880 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6c0735ee-f478-498c-9e89-523519597672 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:29.132502 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6c0735ee-f478-498c-9e89-523519597672 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:29.145699 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6c0735ee-f478-498c-9e89-523519597672 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:29.146283 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6c0735ee-f478-498c-9e89-523519597672 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:29.147306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6c0735ee-f478-498c-9e89-523519597672 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:29.148072 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6c0735ee-f478-498c-9e89-523519597672 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:29.273285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b58fb371-6f19-4218-91c4-70bb16047557 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:29.274149 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b58fb371-6f19-4218-91c4-70bb16047557 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:29.281115 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:29.292322 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b58fb371-6f19-4218-91c4-70bb16047557 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:29.293137 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b58fb371-6f19-4218-91c4-70bb16047557 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:29.294640 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b58fb371-6f19-4218-91c4-70bb16047557 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:29.295443 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b58fb371-6f19-4218-91c4-70bb16047557 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:29.338759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6c0735ee-f478-498c-9e89-523519597672 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:29.351016 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6c0735ee-f478-498c-9e89-523519597672 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.222851 Jun 22 11:48:29.352588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 234/423] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:29 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:29.396029 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b58fb371-6f19-4218-91c4-70bb16047557 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:29.407738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b58fb371-6f19-4218-91c4-70bb16047557 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.138170 Jun 22 11:48:29.408750 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 190/424] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:29 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:30.373575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b8322333-357d-4a93-b18c-e2dc34233934 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:30.374182 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b8322333-357d-4a93-b18c-e2dc34233934 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:30.380877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8322333-357d-4a93-b18c-e2dc34233934 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:30.381315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8322333-357d-4a93-b18c-e2dc34233934 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:30.382091 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8322333-357d-4a93-b18c-e2dc34233934 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:30.382524 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8322333-357d-4a93-b18c-e2dc34233934 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:30.431770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-632e55dc-26ac-4c5f-95ae-a72004cb3418 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:30.433096 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-632e55dc-26ac-4c5f-95ae-a72004cb3418 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:30.447574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-632e55dc-26ac-4c5f-95ae-a72004cb3418 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:30.448331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-632e55dc-26ac-4c5f-95ae-a72004cb3418 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:30.449522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-632e55dc-26ac-4c5f-95ae-a72004cb3418 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:30.450184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-632e55dc-26ac-4c5f-95ae-a72004cb3418 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:30.570065 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-632e55dc-26ac-4c5f-95ae-a72004cb3418 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:30.592670 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-632e55dc-26ac-4c5f-95ae-a72004cb3418 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.164506 Jun 22 11:48:30.593935 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 191/425] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:30 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:30.604475 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b8322333-357d-4a93-b18c-e2dc34233934 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:30.620399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b8322333-357d-4a93-b18c-e2dc34233934 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.250868 Jun 22 11:48:30.621478 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 235/426] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:30 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:31.611666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-de77391b-13f9-44a0-8213-98d52924009d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:31.612959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-de77391b-13f9-44a0-8213-98d52924009d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:31.624225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de77391b-13f9-44a0-8213-98d52924009d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:31.624676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de77391b-13f9-44a0-8213-98d52924009d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:31.625452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de77391b-13f9-44a0-8213-98d52924009d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:31.625881 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de77391b-13f9-44a0-8213-98d52924009d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:31.645360 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3c79d591-ce6e-4331-9023-4fdf0e22186f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:31.646540 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3c79d591-ce6e-4331-9023-4fdf0e22186f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:31.657335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c79d591-ce6e-4331-9023-4fdf0e22186f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:31.657938 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c79d591-ce6e-4331-9023-4fdf0e22186f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:31.659247 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c79d591-ce6e-4331-9023-4fdf0e22186f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:31.660188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c79d591-ce6e-4331-9023-4fdf0e22186f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:31.708282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-de77391b-13f9-44a0-8213-98d52924009d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:31.723901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-de77391b-13f9-44a0-8213-98d52924009d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.115901 Jun 22 11:48:31.724599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 192/427] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:31 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:31.860982 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3c79d591-ce6e-4331-9023-4fdf0e22186f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:31.870659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3c79d591-ce6e-4331-9023-4fdf0e22186f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.231463 Jun 22 11:48:31.872717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 236/428] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:31 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:32.742593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1e60c5a6-dba6-47bf-82c6-3ef2403cf7c3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:32.743228 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1e60c5a6-dba6-47bf-82c6-3ef2403cf7c3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:32.750171 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e60c5a6-dba6-47bf-82c6-3ef2403cf7c3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:32.750595 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e60c5a6-dba6-47bf-82c6-3ef2403cf7c3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:32.751378 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e60c5a6-dba6-47bf-82c6-3ef2403cf7c3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:32.751814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e60c5a6-dba6-47bf-82c6-3ef2403cf7c3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:32.832413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1e60c5a6-dba6-47bf-82c6-3ef2403cf7c3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:32.846203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1e60c5a6-dba6-47bf-82c6-3ef2403cf7c3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.107696 Jun 22 11:48:32.847131 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 193/429] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:32 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:32.893428 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3c84b293-af5a-457b-a695-0386f56652ad tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:32.894113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3c84b293-af5a-457b-a695-0386f56652ad tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:32.900037 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c84b293-af5a-457b-a695-0386f56652ad tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:32.900478 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c84b293-af5a-457b-a695-0386f56652ad tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:32.901237 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c84b293-af5a-457b-a695-0386f56652ad tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:32.901660 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c84b293-af5a-457b-a695-0386f56652ad tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:33.070648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3c84b293-af5a-457b-a695-0386f56652ad tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:33.072960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=96 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:33.084618 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3c84b293-af5a-457b-a695-0386f56652ad tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.195167 Jun 22 11:48:33.085627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 237/430] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:32 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:33.866764 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-03e00784-e2bd-4dd7-b4e5-b7238f3bb8eb tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:33.867452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-03e00784-e2bd-4dd7-b4e5-b7238f3bb8eb tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:33.874841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-03e00784-e2bd-4dd7-b4e5-b7238f3bb8eb tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:33.875430 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-03e00784-e2bd-4dd7-b4e5-b7238f3bb8eb tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:33.876463 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-03e00784-e2bd-4dd7-b4e5-b7238f3bb8eb tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:33.876863 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-03e00784-e2bd-4dd7-b4e5-b7238f3bb8eb tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:33.944264 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-03e00784-e2bd-4dd7-b4e5-b7238f3bb8eb tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:33.952321 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-03e00784-e2bd-4dd7-b4e5-b7238f3bb8eb tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.089487 Jun 22 11:48:33.952884 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 194/431] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:33 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:34.103732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0f0144fe-4ec5-4eea-9326-c7ac72df4dac tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:34.105339 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0f0144fe-4ec5-4eea-9326-c7ac72df4dac tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:34.113081 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f0144fe-4ec5-4eea-9326-c7ac72df4dac tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:34.113532 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f0144fe-4ec5-4eea-9326-c7ac72df4dac tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:34.114574 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f0144fe-4ec5-4eea-9326-c7ac72df4dac tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:34.115209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f0144fe-4ec5-4eea-9326-c7ac72df4dac tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:34.271371 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0f0144fe-4ec5-4eea-9326-c7ac72df4dac tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:34.283544 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0f0144fe-4ec5-4eea-9326-c7ac72df4dac tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.185076 Jun 22 11:48:34.284154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 238/432] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:34 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:34.971148 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9b501d21-8a69-420e-8906-c0bb2fea5a8e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:34.971948 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9b501d21-8a69-420e-8906-c0bb2fea5a8e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:34.982118 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9b501d21-8a69-420e-8906-c0bb2fea5a8e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:34.982704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9b501d21-8a69-420e-8906-c0bb2fea5a8e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:34.983537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9b501d21-8a69-420e-8906-c0bb2fea5a8e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:34.983965 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9b501d21-8a69-420e-8906-c0bb2fea5a8e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:35.057841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9b501d21-8a69-420e-8906-c0bb2fea5a8e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:35.066702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9b501d21-8a69-420e-8906-c0bb2fea5a8e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.099402 Jun 22 11:48:35.067288 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 195/433] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:34 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:35.301481 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-93f64756-0e70-45b1-b877-2ce5bfeac56f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:35.302110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-93f64756-0e70-45b1-b877-2ce5bfeac56f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:35.308980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-93f64756-0e70-45b1-b877-2ce5bfeac56f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:35.309362 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-93f64756-0e70-45b1-b877-2ce5bfeac56f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:35.310164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-93f64756-0e70-45b1-b877-2ce5bfeac56f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:35.310607 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-93f64756-0e70-45b1-b877-2ce5bfeac56f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:35.465775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-93f64756-0e70-45b1-b877-2ce5bfeac56f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:35.473585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-93f64756-0e70-45b1-b877-2ce5bfeac56f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.175950 Jun 22 11:48:35.474156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 239/434] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:35 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:36.085688 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3a6afe6d-6aed-48d3-877f-707a7c50550f tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:36.086310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3a6afe6d-6aed-48d3-877f-707a7c50550f tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:36.093418 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3a6afe6d-6aed-48d3-877f-707a7c50550f tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:36.093861 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3a6afe6d-6aed-48d3-877f-707a7c50550f tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:36.094637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3a6afe6d-6aed-48d3-877f-707a7c50550f tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:36.095066 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3a6afe6d-6aed-48d3-877f-707a7c50550f tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:36.160893 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3a6afe6d-6aed-48d3-877f-707a7c50550f tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:36.163987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:36.172363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3a6afe6d-6aed-48d3-877f-707a7c50550f tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.090312 Jun 22 11:48:36.173102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 196/435] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:36 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:36.493278 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-11d1159d-cfde-4244-a569-36a66665a294 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:36.493958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-11d1159d-cfde-4244-a569-36a66665a294 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:36.496573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:36.497248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=8 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:36.503887 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-11d1159d-cfde-4244-a569-36a66665a294 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:36.505629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-11d1159d-cfde-4244-a569-36a66665a294 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:36.506870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-11d1159d-cfde-4244-a569-36a66665a294 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:36.507459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-11d1159d-cfde-4244-a569-36a66665a294 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:36.658077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-11d1159d-cfde-4244-a569-36a66665a294 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:36.666129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-11d1159d-cfde-4244-a569-36a66665a294 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.176858 Jun 22 11:48:36.666724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 240/436] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:36 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:37.193225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-66c9f7d6-cc3b-41c2-b854-587e6415d762 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:37.194252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-66c9f7d6-cc3b-41c2-b854-587e6415d762 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:37.196306 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=12 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:37.202191 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-66c9f7d6-cc3b-41c2-b854-587e6415d762 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:37.202668 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-66c9f7d6-cc3b-41c2-b854-587e6415d762 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:37.203761 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-66c9f7d6-cc3b-41c2-b854-587e6415d762 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:37.204399 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-66c9f7d6-cc3b-41c2-b854-587e6415d762 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:37.274120 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-66c9f7d6-cc3b-41c2-b854-587e6415d762 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:37.282389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-66c9f7d6-cc3b-41c2-b854-587e6415d762 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.093062 Jun 22 11:48:37.282855 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 197/437] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:37 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:37.684034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f198c55f-9066-4ac3-875f-844e32535965 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:37.684680 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f198c55f-9066-4ac3-875f-844e32535965 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:37.690795 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f198c55f-9066-4ac3-875f-844e32535965 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:37.691238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f198c55f-9066-4ac3-875f-844e32535965 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:37.692054 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f198c55f-9066-4ac3-875f-844e32535965 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:37.692479 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f198c55f-9066-4ac3-875f-844e32535965 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:37.837738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f198c55f-9066-4ac3-875f-844e32535965 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:37.845373 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f198c55f-9066-4ac3-875f-844e32535965 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.166047 Jun 22 11:48:37.846035 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 241/438] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:37 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:38.298591 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e037e239-3f8a-4934-a292-a02fb4a56bf8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:38.299170 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e037e239-3f8a-4934-a292-a02fb4a56bf8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:38.307206 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e037e239-3f8a-4934-a292-a02fb4a56bf8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:38.309796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e037e239-3f8a-4934-a292-a02fb4a56bf8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:38.310637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e037e239-3f8a-4934-a292-a02fb4a56bf8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:38.311222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e037e239-3f8a-4934-a292-a02fb4a56bf8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:38.371741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e037e239-3f8a-4934-a292-a02fb4a56bf8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:38.379175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e037e239-3f8a-4934-a292-a02fb4a56bf8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.084481 Jun 22 11:48:38.379773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 198/439] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:38 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:38.862604 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1661a001-599b-4af1-8744-bc71fc8502f9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:38.863152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1661a001-599b-4af1-8744-bc71fc8502f9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:38.869304 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1661a001-599b-4af1-8744-bc71fc8502f9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:38.869747 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1661a001-599b-4af1-8744-bc71fc8502f9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:38.870545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1661a001-599b-4af1-8744-bc71fc8502f9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:38.871549 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1661a001-599b-4af1-8744-bc71fc8502f9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:39.009723 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1661a001-599b-4af1-8744-bc71fc8502f9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:39.017961 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1661a001-599b-4af1-8744-bc71fc8502f9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.159248 Jun 22 11:48:39.018536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 242/440] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:38 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:39.396761 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-236fe2d0-7f5b-4e86-a0b7-32f9eba09105 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:39.397387 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-236fe2d0-7f5b-4e86-a0b7-32f9eba09105 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:39.404549 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-236fe2d0-7f5b-4e86-a0b7-32f9eba09105 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:39.404991 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-236fe2d0-7f5b-4e86-a0b7-32f9eba09105 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:39.405754 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-236fe2d0-7f5b-4e86-a0b7-32f9eba09105 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:39.406186 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-236fe2d0-7f5b-4e86-a0b7-32f9eba09105 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:39.473522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-236fe2d0-7f5b-4e86-a0b7-32f9eba09105 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:39.485064 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-236fe2d0-7f5b-4e86-a0b7-32f9eba09105 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.091938 Jun 22 11:48:39.488330 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 199/441] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:39 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:40.035557 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7689e445-9ce1-4d1e-abd1-56881290c1be tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:40.036188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7689e445-9ce1-4d1e-abd1-56881290c1be tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:40.042202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7689e445-9ce1-4d1e-abd1-56881290c1be tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:40.042656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7689e445-9ce1-4d1e-abd1-56881290c1be tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:40.043441 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7689e445-9ce1-4d1e-abd1-56881290c1be tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:40.043875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7689e445-9ce1-4d1e-abd1-56881290c1be tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:40.171873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7689e445-9ce1-4d1e-abd1-56881290c1be tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:40.179216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7689e445-9ce1-4d1e-abd1-56881290c1be tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.147460 Jun 22 11:48:40.179803 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 243/442] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:40 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:40.183717 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bf441756-0cd7-4b6e-9c6f-4c147e7f987f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:40.184207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bf441756-0cd7-4b6e-9c6f-4c147e7f987f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:40.190049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bf441756-0cd7-4b6e-9c6f-4c147e7f987f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:40.190486 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bf441756-0cd7-4b6e-9c6f-4c147e7f987f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:40.191231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bf441756-0cd7-4b6e-9c6f-4c147e7f987f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:40.191678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bf441756-0cd7-4b6e-9c6f-4c147e7f987f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:40.213476 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bf441756-0cd7-4b6e-9c6f-4c147e7f987f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/ips" status: 200 len: 147 microversion: 2.1 time: 0.034074 Jun 22 11:48:40.213987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 200/443] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 11:48:40 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/ips => generated 147 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:48:40.512319 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c1581b8e-5b10-402f-8a94-0ef104df6378 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:40.512904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c1581b8e-5b10-402f-8a94-0ef104df6378 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:40.519214 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c1581b8e-5b10-402f-8a94-0ef104df6378 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:40.519683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c1581b8e-5b10-402f-8a94-0ef104df6378 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:40.520439 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c1581b8e-5b10-402f-8a94-0ef104df6378 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:40.520867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c1581b8e-5b10-402f-8a94-0ef104df6378 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:40.581278 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c1581b8e-5b10-402f-8a94-0ef104df6378 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:40.588864 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c1581b8e-5b10-402f-8a94-0ef104df6378 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.080523 Jun 22 11:48:40.589960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 244/444] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:40 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:41.196993 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-db541867-fb30-47ff-bfac-8a3fc3b9a259 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:41.197749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-db541867-fb30-47ff-bfac-8a3fc3b9a259 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:41.204913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-db541867-fb30-47ff-bfac-8a3fc3b9a259 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:41.205349 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-db541867-fb30-47ff-bfac-8a3fc3b9a259 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:41.206119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-db541867-fb30-47ff-bfac-8a3fc3b9a259 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:41.206546 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-db541867-fb30-47ff-bfac-8a3fc3b9a259 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:41.342711 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-db541867-fb30-47ff-bfac-8a3fc3b9a259 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:41.350337 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-db541867-fb30-47ff-bfac-8a3fc3b9a259 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.157425 Jun 22 11:48:41.350941 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 201/445] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:41 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:41.606861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-94808049-1dfb-4ae8-867d-8cd3ed0b3a85 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:41.607424 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-94808049-1dfb-4ae8-867d-8cd3ed0b3a85 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:41.613979 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-94808049-1dfb-4ae8-867d-8cd3ed0b3a85 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:41.614425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-94808049-1dfb-4ae8-867d-8cd3ed0b3a85 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:41.615197 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-94808049-1dfb-4ae8-867d-8cd3ed0b3a85 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:41.615659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-94808049-1dfb-4ae8-867d-8cd3ed0b3a85 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:41.676822 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-94808049-1dfb-4ae8-867d-8cd3ed0b3a85 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:41.685011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-94808049-1dfb-4ae8-867d-8cd3ed0b3a85 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.082697 Jun 22 11:48:41.685570 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 245/446] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:41 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:42.367913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-303d717a-6d4b-4478-8a6c-5a82207970cb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:42.368720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-303d717a-6d4b-4478-8a6c-5a82207970cb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:42.375656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-303d717a-6d4b-4478-8a6c-5a82207970cb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:42.376107 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-303d717a-6d4b-4478-8a6c-5a82207970cb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:42.376908 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-303d717a-6d4b-4478-8a6c-5a82207970cb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:42.377285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-303d717a-6d4b-4478-8a6c-5a82207970cb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:42.506164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-303d717a-6d4b-4478-8a6c-5a82207970cb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:42.513684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-303d717a-6d4b-4478-8a6c-5a82207970cb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.149579 Jun 22 11:48:42.514253 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 202/447] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:42 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:42.702505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e2ce9c31-6185-4461-ba36-b2d257606c39 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:42.703109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e2ce9c31-6185-4461-ba36-b2d257606c39 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:42.709307 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e2ce9c31-6185-4461-ba36-b2d257606c39 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:42.709743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e2ce9c31-6185-4461-ba36-b2d257606c39 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:42.710508 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e2ce9c31-6185-4461-ba36-b2d257606c39 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:42.710938 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e2ce9c31-6185-4461-ba36-b2d257606c39 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:42.775272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e2ce9c31-6185-4461-ba36-b2d257606c39 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:42.785015 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e2ce9c31-6185-4461-ba36-b2d257606c39 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.086981 Jun 22 11:48:42.785607 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 246/448] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:42 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:43.533035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7f150d77-a4ba-4f8e-8d4d-f736d1de20a6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:43.533602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7f150d77-a4ba-4f8e-8d4d-f736d1de20a6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:43.540437 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f150d77-a4ba-4f8e-8d4d-f736d1de20a6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:43.540877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f150d77-a4ba-4f8e-8d4d-f736d1de20a6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:43.541637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f150d77-a4ba-4f8e-8d4d-f736d1de20a6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:43.542061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f150d77-a4ba-4f8e-8d4d-f736d1de20a6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:43.688904 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7f150d77-a4ba-4f8e-8d4d-f736d1de20a6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:43.696686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7f150d77-a4ba-4f8e-8d4d-f736d1de20a6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.167928 Jun 22 11:48:43.697274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 203/449] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:43 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:43.802211 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a1900fad-0c73-4e7c-b66d-2d3f57b01f55 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:43.802758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a1900fad-0c73-4e7c-b66d-2d3f57b01f55 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:43.808961 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1900fad-0c73-4e7c-b66d-2d3f57b01f55 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:43.809415 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1900fad-0c73-4e7c-b66d-2d3f57b01f55 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:43.810257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1900fad-0c73-4e7c-b66d-2d3f57b01f55 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:43.810709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1900fad-0c73-4e7c-b66d-2d3f57b01f55 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:43.892997 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a1900fad-0c73-4e7c-b66d-2d3f57b01f55 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:43.901137 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a1900fad-0c73-4e7c-b66d-2d3f57b01f55 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1138 microversion: 2.1 time: 0.102733 Jun 22 11:48:43.902473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 247/450] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:43 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1138 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:44.305946 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-36d2f5ba-a327-4b20-ac80-f01a98b5fead tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a09eb430-60ec-47e7-bceb-7f1cddc59961"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:44.309175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-36d2f5ba-a327-4b20-ac80-f01a98b5fead tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:44.322626 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36d2f5ba-a327-4b20-ac80-f01a98b5fead tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:44.323641 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36d2f5ba-a327-4b20-ac80-f01a98b5fead tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:44.325274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36d2f5ba-a327-4b20-ac80-f01a98b5fead tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:44.326039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36d2f5ba-a327-4b20-ac80-f01a98b5fead tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:44.618048 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-2e4e9f67-9f05-46be-8a74-4953ad040e1f req-eaef9cf2-67ea-4f4a-8252-6ee9da0dd302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3e9cd1-e3da-436f-a4e7-f6c953c83df4", "tag": "a4726067-df3c-4a9b-939a-61e6fd9345db"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:44.643809 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-2e4e9f67-9f05-46be-8a74-4953ad040e1f req-eaef9cf2-67ea-4f4a-8252-6ee9da0dd302 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:44.644322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-2e4e9f67-9f05-46be-8a74-4953ad040e1f req-eaef9cf2-67ea-4f4a-8252-6ee9da0dd302 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:44.659977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-2e4e9f67-9f05-46be-8a74-4953ad040e1f req-eaef9cf2-67ea-4f4a-8252-6ee9da0dd302 service nova] Creating event network-changed:a4726067-df3c-4a9b-939a-61e6fd9345db for instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 on hv-cinder-83697 Jun 22 11:48:44.666991 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-2e4e9f67-9f05-46be-8a74-4953ad040e1f req-eaef9cf2-67ea-4f4a-8252-6ee9da0dd302 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056125 Jun 22 11:48:44.668228 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 248/451] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:48:44.723419 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5f8ea6d3-fee0-4b97-8ad4-fa0cc0ad31f3 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:44.725212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5f8ea6d3-fee0-4b97-8ad4-fa0cc0ad31f3 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:44.738976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5f8ea6d3-fee0-4b97-8ad4-fa0cc0ad31f3 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:44.739928 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5f8ea6d3-fee0-4b97-8ad4-fa0cc0ad31f3 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:44.741145 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5f8ea6d3-fee0-4b97-8ad4-fa0cc0ad31f3 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:44.741663 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5f8ea6d3-fee0-4b97-8ad4-fa0cc0ad31f3 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:44.848784 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-36d2f5ba-a327-4b20-ac80-f01a98b5fead tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550426 Jun 22 11:48:44.850409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 204/452] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 11:48:44 2022] POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/os-volume_attachments => generated 194 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:48:44.924136 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ab1cc54e-6810-4bda-9339-c59814cf894b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:44.925187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ab1cc54e-6810-4bda-9339-c59814cf894b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:44.940310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ab1cc54e-6810-4bda-9339-c59814cf894b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:44.942045 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ab1cc54e-6810-4bda-9339-c59814cf894b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:44.945513 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ab1cc54e-6810-4bda-9339-c59814cf894b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:44.948854 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ab1cc54e-6810-4bda-9339-c59814cf894b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:45.129943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ab1cc54e-6810-4bda-9339-c59814cf894b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:45.138341 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ab1cc54e-6810-4bda-9339-c59814cf894b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1204 microversion: 2.1 time: 0.220734 Jun 22 11:48:45.152215 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 205/453] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:44 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1204 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:45.224083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5f8ea6d3-fee0-4b97-8ad4-fa0cc0ad31f3 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:45.242351 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5f8ea6d3-fee0-4b97-8ad4-fa0cc0ad31f3 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.529902 Jun 22 11:48:45.243086 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 249/454] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:44 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:46.157029 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7e2a4376-4a2d-4bf2-8bcc-01647f1e8e89 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:46.157683 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7e2a4376-4a2d-4bf2-8bcc-01647f1e8e89 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:46.164422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e2a4376-4a2d-4bf2-8bcc-01647f1e8e89 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:46.164862 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e2a4376-4a2d-4bf2-8bcc-01647f1e8e89 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:46.165623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e2a4376-4a2d-4bf2-8bcc-01647f1e8e89 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:46.166042 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e2a4376-4a2d-4bf2-8bcc-01647f1e8e89 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:46.259173 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-735bccd0-1dd9-488a-ae88-80c0b34fcaf2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:46.260051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-735bccd0-1dd9-488a-ae88-80c0b34fcaf2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:46.266811 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-735bccd0-1dd9-488a-ae88-80c0b34fcaf2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:46.267256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-735bccd0-1dd9-488a-ae88-80c0b34fcaf2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:46.268056 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-735bccd0-1dd9-488a-ae88-80c0b34fcaf2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:46.268487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-735bccd0-1dd9-488a-ae88-80c0b34fcaf2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:46.308016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7e2a4376-4a2d-4bf2-8bcc-01647f1e8e89 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:46.315647 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7e2a4376-4a2d-4bf2-8bcc-01647f1e8e89 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1272 microversion: 2.1 time: 0.162381 Jun 22 11:48:46.316242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 206/455] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:46 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:46.407434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-735bccd0-1dd9-488a-ae88-80c0b34fcaf2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:46.414977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-735bccd0-1dd9-488a-ae88-80c0b34fcaf2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.159658 Jun 22 11:48:46.415575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 250/456] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:46 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:47.333353 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bdea3b80-87a4-4c22-b97e-eeb3f156c075 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:47.334047 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bdea3b80-87a4-4c22-b97e-eeb3f156c075 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:47.341882 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bdea3b80-87a4-4c22-b97e-eeb3f156c075 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:47.342403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bdea3b80-87a4-4c22-b97e-eeb3f156c075 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:47.343391 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bdea3b80-87a4-4c22-b97e-eeb3f156c075 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:47.344067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bdea3b80-87a4-4c22-b97e-eeb3f156c075 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:47.432548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1ebd84a8-b989-43c7-a934-1fa77325fefb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:47.434085 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1ebd84a8-b989-43c7-a934-1fa77325fefb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:47.440453 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1ebd84a8-b989-43c7-a934-1fa77325fefb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:47.441081 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1ebd84a8-b989-43c7-a934-1fa77325fefb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:47.441903 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1ebd84a8-b989-43c7-a934-1fa77325fefb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:47.442398 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1ebd84a8-b989-43c7-a934-1fa77325fefb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:47.501419 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bdea3b80-87a4-4c22-b97e-eeb3f156c075 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:47.509190 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bdea3b80-87a4-4c22-b97e-eeb3f156c075 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1272 microversion: 2.1 time: 0.179952 Jun 22 11:48:47.510025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 207/457] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:47 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:47.586924 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1ebd84a8-b989-43c7-a934-1fa77325fefb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:47.595008 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1ebd84a8-b989-43c7-a934-1fa77325fefb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.166998 Jun 22 11:48:47.595601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 251/458] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:47 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:48.527693 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1b846e27-3c34-446f-8867-0310f43ec10b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:48.528415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1b846e27-3c34-446f-8867-0310f43ec10b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:48.531053 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:48.537423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1b846e27-3c34-446f-8867-0310f43ec10b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:48.537905 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1b846e27-3c34-446f-8867-0310f43ec10b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:48.538686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1b846e27-3c34-446f-8867-0310f43ec10b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:48.539118 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1b846e27-3c34-446f-8867-0310f43ec10b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:48.611946 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-be30f369-c408-4f3b-a5cc-e200c363b8f5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:48.612676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-be30f369-c408-4f3b-a5cc-e200c363b8f5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:48.618910 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-be30f369-c408-4f3b-a5cc-e200c363b8f5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:48.619376 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-be30f369-c408-4f3b-a5cc-e200c363b8f5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:48.620206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-be30f369-c408-4f3b-a5cc-e200c363b8f5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:48.621161 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-be30f369-c408-4f3b-a5cc-e200c363b8f5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:48.704300 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1b846e27-3c34-446f-8867-0310f43ec10b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:48.713176 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1b846e27-3c34-446f-8867-0310f43ec10b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1272 microversion: 2.1 time: 0.189221 Jun 22 11:48:48.722457 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 208/459] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:48 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:48.778883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-be30f369-c408-4f3b-a5cc-e200c363b8f5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:48.786713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-be30f369-c408-4f3b-a5cc-e200c363b8f5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.178706 Jun 22 11:48:48.787889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 252/460] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:48 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:49.730575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bc81389f-1a02-4c85-bc47-f6428e95894d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:49.731145 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bc81389f-1a02-4c85-bc47-f6428e95894d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:49.737570 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bc81389f-1a02-4c85-bc47-f6428e95894d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:49.738008 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bc81389f-1a02-4c85-bc47-f6428e95894d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:49.738751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bc81389f-1a02-4c85-bc47-f6428e95894d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:49.739175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bc81389f-1a02-4c85-bc47-f6428e95894d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:49.804843 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-49acf897-f222-4b08-9dd1-fcfcf5b2cbe5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:49.805460 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-49acf897-f222-4b08-9dd1-fcfcf5b2cbe5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:49.814099 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-49acf897-f222-4b08-9dd1-fcfcf5b2cbe5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:49.814620 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-49acf897-f222-4b08-9dd1-fcfcf5b2cbe5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:49.815596 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-49acf897-f222-4b08-9dd1-fcfcf5b2cbe5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:49.816167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-49acf897-f222-4b08-9dd1-fcfcf5b2cbe5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:49.914076 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bc81389f-1a02-4c85-bc47-f6428e95894d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:49.923029 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bc81389f-1a02-4c85-bc47-f6428e95894d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1272 microversion: 2.1 time: 0.196369 Jun 22 11:48:49.932373 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 209/461] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:49 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:49.973366 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-49acf897-f222-4b08-9dd1-fcfcf5b2cbe5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:49.981885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-49acf897-f222-4b08-9dd1-fcfcf5b2cbe5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.180875 Jun 22 11:48:49.982379 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 253/462] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:49 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:50.940063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a9fbec3f-143d-4c49-b812-4bae8e9617f5 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:50.940639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a9fbec3f-143d-4c49-b812-4bae8e9617f5 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:50.947454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a9fbec3f-143d-4c49-b812-4bae8e9617f5 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:50.947899 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a9fbec3f-143d-4c49-b812-4bae8e9617f5 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:50.949160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a9fbec3f-143d-4c49-b812-4bae8e9617f5 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:50.949585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a9fbec3f-143d-4c49-b812-4bae8e9617f5 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:51.000347 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2cbc7993-d0d5-4e56-a8a8-c7074fc30e43 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:51.000949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2cbc7993-d0d5-4e56-a8a8-c7074fc30e43 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:51.007852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2cbc7993-d0d5-4e56-a8a8-c7074fc30e43 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:51.008625 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2cbc7993-d0d5-4e56-a8a8-c7074fc30e43 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:51.009685 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2cbc7993-d0d5-4e56-a8a8-c7074fc30e43 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:51.010374 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2cbc7993-d0d5-4e56-a8a8-c7074fc30e43 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:51.126568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a9fbec3f-143d-4c49-b812-4bae8e9617f5 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:51.134737 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a9fbec3f-143d-4c49-b812-4bae8e9617f5 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1272 microversion: 2.1 time: 0.198471 Jun 22 11:48:51.135608 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 210/463] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:50 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:51.188109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2cbc7993-d0d5-4e56-a8a8-c7074fc30e43 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:51.195788 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2cbc7993-d0d5-4e56-a8a8-c7074fc30e43 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.200629 Jun 22 11:48:51.196371 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 254/464] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:50 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:52.153118 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-669fdd2f-b7cd-4474-89fc-cc3a259b2cae tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:52.153798 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-669fdd2f-b7cd-4474-89fc-cc3a259b2cae tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:52.160625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-669fdd2f-b7cd-4474-89fc-cc3a259b2cae tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:52.161050 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-669fdd2f-b7cd-4474-89fc-cc3a259b2cae tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:52.163457 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-669fdd2f-b7cd-4474-89fc-cc3a259b2cae tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:52.163457 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-669fdd2f-b7cd-4474-89fc-cc3a259b2cae tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:52.213144 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-39161979-98c9-4f7f-8f76-c8068d9aa809 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:52.213990 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-39161979-98c9-4f7f-8f76-c8068d9aa809 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:52.220299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-39161979-98c9-4f7f-8f76-c8068d9aa809 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:52.220732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-39161979-98c9-4f7f-8f76-c8068d9aa809 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:52.221501 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-39161979-98c9-4f7f-8f76-c8068d9aa809 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:52.221923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-39161979-98c9-4f7f-8f76-c8068d9aa809 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:52.224852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:52.653173 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-669fdd2f-b7cd-4474-89fc-cc3a259b2cae tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:52.661540 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-669fdd2f-b7cd-4474-89fc-cc3a259b2cae tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1272 microversion: 2.1 time: 0.512157 Jun 22 11:48:52.662654 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 211/465] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:52 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:52.678603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-39161979-98c9-4f7f-8f76-c8068d9aa809 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:52.687979 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-39161979-98c9-4f7f-8f76-c8068d9aa809 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.478510 Jun 22 11:48:52.688767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 255/466] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:52 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:53.512238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-c217d784-dceb-4d09-a50b-6bc17ea78ba3 req-17758bdf-f65e-48b7-b8da-a32e59d76473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3eb4a54-d3df-4eca-b1ef-3dcb13716d61", "tag": "372fe7e2-a11e-410a-ad0b-3ed41c865845"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:53.523292 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-c217d784-dceb-4d09-a50b-6bc17ea78ba3 req-17758bdf-f65e-48b7-b8da-a32e59d76473 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:53.524139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-c217d784-dceb-4d09-a50b-6bc17ea78ba3 req-17758bdf-f65e-48b7-b8da-a32e59d76473 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:53.538466 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-c217d784-dceb-4d09-a50b-6bc17ea78ba3 req-17758bdf-f65e-48b7-b8da-a32e59d76473 service nova] Creating event network-changed:372fe7e2-a11e-410a-ad0b-3ed41c865845 for instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 on hv-cinder-83697 Jun 22 11:48:53.545072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-c217d784-dceb-4d09-a50b-6bc17ea78ba3 req-17758bdf-f65e-48b7-b8da-a32e59d76473 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036926 Jun 22 11:48:53.546515 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 212/467] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:48:53.681662 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-17b2132d-16a9-434f-97df-1e538b17e867 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:53.683391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-17b2132d-16a9-434f-97df-1e538b17e867 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:53.696436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17b2132d-16a9-434f-97df-1e538b17e867 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:53.696881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17b2132d-16a9-434f-97df-1e538b17e867 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:53.697668 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17b2132d-16a9-434f-97df-1e538b17e867 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:53.698647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17b2132d-16a9-434f-97df-1e538b17e867 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:53.709667 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-afe29a6d-8702-418e-80cf-22f4ca8fb90b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:53.710464 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-afe29a6d-8702-418e-80cf-22f4ca8fb90b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:53.720146 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-afe29a6d-8702-418e-80cf-22f4ca8fb90b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:53.720388 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-afe29a6d-8702-418e-80cf-22f4ca8fb90b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:53.721171 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-afe29a6d-8702-418e-80cf-22f4ca8fb90b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:53.721619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-afe29a6d-8702-418e-80cf-22f4ca8fb90b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:53.745016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:53.912385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-17b2132d-16a9-434f-97df-1e538b17e867 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:53.923727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-17b2132d-16a9-434f-97df-1e538b17e867 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.249047 Jun 22 11:48:53.924306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 256/468] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:53 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:53.952053 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-afe29a6d-8702-418e-80cf-22f4ca8fb90b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:53.960134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-afe29a6d-8702-418e-80cf-22f4ca8fb90b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.255429 Jun 22 11:48:53.960707 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 213/469] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:53 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:54.703304 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-4110a504-20a3-4e5b-b781-99079d2c8205 req-21d90b20-4dc2-48f1-a700-395045e285c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3e9cd1-e3da-436f-a4e7-f6c953c83df4", "name": "network-vif-plugged", "status": "completed", "tag": "a4726067-df3c-4a9b-939a-61e6fd9345db"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:48:54.711771 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-4110a504-20a3-4e5b-b781-99079d2c8205 req-21d90b20-4dc2-48f1-a700-395045e285c8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:54.712214 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-4110a504-20a3-4e5b-b781-99079d2c8205 req-21d90b20-4dc2-48f1-a700-395045e285c8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:54.727206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-4110a504-20a3-4e5b-b781-99079d2c8205 req-21d90b20-4dc2-48f1-a700-395045e285c8 service nova] Creating event network-vif-plugged:a4726067-df3c-4a9b-939a-61e6fd9345db for instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 on hv-cinder-83697 Jun 22 11:48:54.732588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-4110a504-20a3-4e5b-b781-99079d2c8205 req-21d90b20-4dc2-48f1-a700-395045e285c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Jun 22 11:48:54.733544 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 257/470] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:48:54.945448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-36259478-a142-45ae-aba9-6aad3a3413f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:54.945448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-36259478-a142-45ae-aba9-6aad3a3413f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:54.952464 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36259478-a142-45ae-aba9-6aad3a3413f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:54.952936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36259478-a142-45ae-aba9-6aad3a3413f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:54.953760 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36259478-a142-45ae-aba9-6aad3a3413f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:54.954133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36259478-a142-45ae-aba9-6aad3a3413f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:54.981922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9102ee8a-b7fa-48ab-a364-4a770678d74c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:54.982932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9102ee8a-b7fa-48ab-a364-4a770678d74c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:54.993285 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9102ee8a-b7fa-48ab-a364-4a770678d74c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:54.994051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9102ee8a-b7fa-48ab-a364-4a770678d74c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:54.995429 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9102ee8a-b7fa-48ab-a364-4a770678d74c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:54.996294 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9102ee8a-b7fa-48ab-a364-4a770678d74c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:55.156275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-36259478-a142-45ae-aba9-6aad3a3413f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:55.173701 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-36259478-a142-45ae-aba9-6aad3a3413f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.232740 Jun 22 11:48:55.174283 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 214/471] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:54 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:55.184303 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9102ee8a-b7fa-48ab-a364-4a770678d74c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:55.192147 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9102ee8a-b7fa-48ab-a364-4a770678d74c tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.218635 Jun 22 11:48:55.192724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 258/472] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:54 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:56.193177 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f0fa8172-e04e-45dd-b785-43b29ff502f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:56.193772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f0fa8172-e04e-45dd-b785-43b29ff502f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:56.200685 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f0fa8172-e04e-45dd-b785-43b29ff502f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:56.201135 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f0fa8172-e04e-45dd-b785-43b29ff502f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:56.201902 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f0fa8172-e04e-45dd-b785-43b29ff502f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:56.202332 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f0fa8172-e04e-45dd-b785-43b29ff502f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:56.209445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-55f57d50-1400-4084-b03e-7b261af2232e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:56.210082 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-55f57d50-1400-4084-b03e-7b261af2232e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:56.212169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:48:56.217937 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-55f57d50-1400-4084-b03e-7b261af2232e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:56.218386 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-55f57d50-1400-4084-b03e-7b261af2232e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:56.219178 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-55f57d50-1400-4084-b03e-7b261af2232e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:56.219639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-55f57d50-1400-4084-b03e-7b261af2232e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:56.418916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f0fa8172-e04e-45dd-b785-43b29ff502f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:56.426450 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f0fa8172-e04e-45dd-b785-43b29ff502f6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.237171 Jun 22 11:48:56.426620 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-55f57d50-1400-4084-b03e-7b261af2232e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:56.427022 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 215/473] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:56 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:56.434177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-55f57d50-1400-4084-b03e-7b261af2232e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.228630 Jun 22 11:48:56.434743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 259/474] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:56 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:57.443713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e00c8bd0-6a8f-49e1-b91c-b4dce5c1e8a7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:57.444313 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e00c8bd0-6a8f-49e1-b91c-b4dce5c1e8a7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:57.450735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e00c8bd0-6a8f-49e1-b91c-b4dce5c1e8a7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:57.450941 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9398ec94-c030-4944-b92d-8a61935ba4b8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:57.451405 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e00c8bd0-6a8f-49e1-b91c-b4dce5c1e8a7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:57.451518 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9398ec94-c030-4944-b92d-8a61935ba4b8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:57.451979 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e00c8bd0-6a8f-49e1-b91c-b4dce5c1e8a7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:57.452404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e00c8bd0-6a8f-49e1-b91c-b4dce5c1e8a7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:57.457697 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9398ec94-c030-4944-b92d-8a61935ba4b8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:57.458145 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9398ec94-c030-4944-b92d-8a61935ba4b8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:57.458916 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9398ec94-c030-4944-b92d-8a61935ba4b8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:57.459396 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9398ec94-c030-4944-b92d-8a61935ba4b8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:57.650662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e00c8bd0-6a8f-49e1-b91c-b4dce5c1e8a7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:57.658812 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e00c8bd0-6a8f-49e1-b91c-b4dce5c1e8a7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.218891 Jun 22 11:48:57.661560 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 216/475] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:57 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:57.661991 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9398ec94-c030-4944-b92d-8a61935ba4b8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:57.670265 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9398ec94-c030-4944-b92d-8a61935ba4b8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.223151 Jun 22 11:48:57.670842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 260/476] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:57 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:58.675525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8587c046-1df7-4a46-8aa3-2274c2502ecf tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:58.676129 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8587c046-1df7-4a46-8aa3-2274c2502ecf tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:58.683190 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8587c046-1df7-4a46-8aa3-2274c2502ecf tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:58.683660 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8587c046-1df7-4a46-8aa3-2274c2502ecf tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:58.684423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8587c046-1df7-4a46-8aa3-2274c2502ecf tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:58.684849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8587c046-1df7-4a46-8aa3-2274c2502ecf tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:58.687933 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c7ea74b9-f83c-430b-9e55-c51d9956722f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:58.688654 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c7ea74b9-f83c-430b-9e55-c51d9956722f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:58.694797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c7ea74b9-f83c-430b-9e55-c51d9956722f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:58.695237 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c7ea74b9-f83c-430b-9e55-c51d9956722f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:58.696020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c7ea74b9-f83c-430b-9e55-c51d9956722f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:58.696446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c7ea74b9-f83c-430b-9e55-c51d9956722f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:58.886804 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8587c046-1df7-4a46-8aa3-2274c2502ecf tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:58.890548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c7ea74b9-f83c-430b-9e55-c51d9956722f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:48:58.894867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8587c046-1df7-4a46-8aa3-2274c2502ecf tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.223103 Jun 22 11:48:58.895551 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 217/477] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:58 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:48:58.898822 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c7ea74b9-f83c-430b-9e55-c51d9956722f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1359 microversion: 2.1 time: 0.215052 Jun 22 11:48:58.899705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 261/478] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:58 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:48:59.913291 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-04340916-1775-4400-81c9-517c0f3f4414 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:59.913969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-04340916-1775-4400-81c9-517c0f3f4414 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:59.916773 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-53f50aab-a0b3-4263-811c-32d489142cf1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:48:59.917389 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-53f50aab-a0b3-4263-811c-32d489142cf1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:48:59.920516 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-04340916-1775-4400-81c9-517c0f3f4414 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:59.920962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-04340916-1775-4400-81c9-517c0f3f4414 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:59.921749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-04340916-1775-4400-81c9-517c0f3f4414 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:59.922182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-04340916-1775-4400-81c9-517c0f3f4414 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:59.923333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-53f50aab-a0b3-4263-811c-32d489142cf1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:59.923816 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-53f50aab-a0b3-4263-811c-32d489142cf1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:48:59.924588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-53f50aab-a0b3-4263-811c-32d489142cf1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:48:59.925018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-53f50aab-a0b3-4263-811c-32d489142cf1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:00.136032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-04340916-1775-4400-81c9-517c0f3f4414 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:00.145140 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-04340916-1775-4400-81c9-517c0f3f4414 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.235872 Jun 22 11:49:00.146404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 218/479] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:59 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:00.147821 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-53f50aab-a0b3-4263-811c-32d489142cf1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:00.177647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-53f50aab-a0b3-4263-811c-32d489142cf1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1549 microversion: 2.1 time: 0.264269 Jun 22 11:49:00.178611 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 262/480] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:48:59 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1549 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:00.196071 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6d30bf0d-2469-4e48-9bca-25dcd8f7ffa8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:00.196596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6d30bf0d-2469-4e48-9bca-25dcd8f7ffa8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:00.204256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d30bf0d-2469-4e48-9bca-25dcd8f7ffa8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:00.205020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d30bf0d-2469-4e48-9bca-25dcd8f7ffa8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:00.206124 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d30bf0d-2469-4e48-9bca-25dcd8f7ffa8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:00.206639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d30bf0d-2469-4e48-9bca-25dcd8f7ffa8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:00.345900 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6d30bf0d-2469-4e48-9bca-25dcd8f7ffa8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:00.354258 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6d30bf0d-2469-4e48-9bca-25dcd8f7ffa8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1549 microversion: 2.1 time: 0.161963 Jun 22 11:49:00.354871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 219/481] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:00 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:00.370472 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:00.374362 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:00.375440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Searching by: {'deleted': False, 'project_id': '2975e2c648284a80824126eecc5d0269'} {{(pid=129528) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 11:49:00.383227 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:00.383769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:00.384562 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:00.384990 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:00.476867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.multi_cell_list [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129528) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 11:49:00.569958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-adda4ad5-8f93-401a-8311-5d44d7fd7c23 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203677 Jun 22 11:49:00.570541 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 263/482] 10.222.0.36 () {58 vars in 1124 bytes} [Wed Jun 22 11:49:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:49:00.580646 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5555b140-f839-4d50-b42b-c51498de5102 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:00.581251 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5555b140-f839-4d50-b42b-c51498de5102 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:00.587377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5555b140-f839-4d50-b42b-c51498de5102 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:00.587820 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5555b140-f839-4d50-b42b-c51498de5102 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:00.588571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5555b140-f839-4d50-b42b-c51498de5102 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:00.589007 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5555b140-f839-4d50-b42b-c51498de5102 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:00.719960 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5555b140-f839-4d50-b42b-c51498de5102 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:00.727491 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5555b140-f839-4d50-b42b-c51498de5102 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1549 microversion: 2.1 time: 0.150519 Jun 22 11:49:00.728048 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 220/483] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:00 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:01.162568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c671d852-98e1-4429-9a1b-0257be6ca2d6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:01.163172 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c671d852-98e1-4429-9a1b-0257be6ca2d6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:01.169729 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c671d852-98e1-4429-9a1b-0257be6ca2d6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:01.170169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c671d852-98e1-4429-9a1b-0257be6ca2d6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:01.170924 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c671d852-98e1-4429-9a1b-0257be6ca2d6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:01.171368 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c671d852-98e1-4429-9a1b-0257be6ca2d6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:01.316740 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c671d852-98e1-4429-9a1b-0257be6ca2d6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:01.325046 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c671d852-98e1-4429-9a1b-0257be6ca2d6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.166274 Jun 22 11:49:01.325628 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 264/484] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:01 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:01.903982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7ff06f93-de26-4ced-8b16-01b47507b8c5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:49:01.910903 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7ff06f93-de26-4ced-8b16-01b47507b8c5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:01.911376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7ff06f93-de26-4ced-8b16-01b47507b8c5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:01.974612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7ff06f93-de26-4ced-8b16-01b47507b8c5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Going to try to stop instance {{(pid=129527) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 11:49:02.016841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7ff06f93-de26-4ced-8b16-01b47507b8c5 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/action" status: 202 len: 0 microversion: 2.1 time: 0.116906 Jun 22 11:49:02.017439 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 221/485] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:49:01 2022] POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:49:02.025390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2b36fd39-52e3-451a-9fde-c73ae6d6f8c6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:02.025989 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2b36fd39-52e3-451a-9fde-c73ae6d6f8c6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:02.032808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2b36fd39-52e3-451a-9fde-c73ae6d6f8c6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:02.033250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2b36fd39-52e3-451a-9fde-c73ae6d6f8c6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:02.034029 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2b36fd39-52e3-451a-9fde-c73ae6d6f8c6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:02.034576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2b36fd39-52e3-451a-9fde-c73ae6d6f8c6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:02.179593 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2b36fd39-52e3-451a-9fde-c73ae6d6f8c6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:02.188061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2b36fd39-52e3-451a-9fde-c73ae6d6f8c6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.166435 Jun 22 11:49:02.188844 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 265/486] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:02 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:02.342523 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-64d201ea-85e3-4cf3-9702-51f3f1a0b392 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:02.343133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-64d201ea-85e3-4cf3-9702-51f3f1a0b392 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:02.349266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-64d201ea-85e3-4cf3-9702-51f3f1a0b392 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:02.349706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-64d201ea-85e3-4cf3-9702-51f3f1a0b392 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:02.350461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-64d201ea-85e3-4cf3-9702-51f3f1a0b392 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:02.350891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-64d201ea-85e3-4cf3-9702-51f3f1a0b392 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:02.489637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-64d201ea-85e3-4cf3-9702-51f3f1a0b392 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:02.497302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-64d201ea-85e3-4cf3-9702-51f3f1a0b392 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.159757 Jun 22 11:49:02.497871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 222/487] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:02 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:03.205167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9071e157-94a4-4e89-9d31-f9341d5fcf60 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:03.205837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9071e157-94a4-4e89-9d31-f9341d5fcf60 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:03.211912 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9071e157-94a4-4e89-9d31-f9341d5fcf60 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:03.212434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9071e157-94a4-4e89-9d31-f9341d5fcf60 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:03.213244 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9071e157-94a4-4e89-9d31-f9341d5fcf60 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:03.213739 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9071e157-94a4-4e89-9d31-f9341d5fcf60 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:03.311240 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e7192aad-125d-4dfa-a1c5-a2dc7909c1d5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a10f720e-28d8-4a27-8dae-e0c775252572"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:49:03.312389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e7192aad-125d-4dfa-a1c5-a2dc7909c1d5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:03.318722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e7192aad-125d-4dfa-a1c5-a2dc7909c1d5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:03.319170 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e7192aad-125d-4dfa-a1c5-a2dc7909c1d5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:03.319971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e7192aad-125d-4dfa-a1c5-a2dc7909c1d5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:03.320427 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e7192aad-125d-4dfa-a1c5-a2dc7909c1d5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:03.346796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9071e157-94a4-4e89-9d31-f9341d5fcf60 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:03.361454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9071e157-94a4-4e89-9d31-f9341d5fcf60 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.159954 Jun 22 11:49:03.362032 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 266/488] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:03 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:03.514405 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-af93363a-586a-4633-9ad5-258b52d9c436 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:03.514923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-af93363a-586a-4633-9ad5-258b52d9c436 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:03.521258 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af93363a-586a-4633-9ad5-258b52d9c436 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:03.521705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af93363a-586a-4633-9ad5-258b52d9c436 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:03.522490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af93363a-586a-4633-9ad5-258b52d9c436 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:03.522925 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-af93363a-586a-4633-9ad5-258b52d9c436 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:03.653592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-af93363a-586a-4633-9ad5-258b52d9c436 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:03.663001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-af93363a-586a-4633-9ad5-258b52d9c436 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.152749 Jun 22 11:49:03.664056 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 267/489] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:03 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:04.379437 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f83af44c-bfa2-46d7-a80c-989a6e106e70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:04.380044 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f83af44c-bfa2-46d7-a80c-989a6e106e70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:04.385918 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f83af44c-bfa2-46d7-a80c-989a6e106e70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:04.386358 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f83af44c-bfa2-46d7-a80c-989a6e106e70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:04.387104 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f83af44c-bfa2-46d7-a80c-989a6e106e70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:04.387563 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f83af44c-bfa2-46d7-a80c-989a6e106e70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:04.518631 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f83af44c-bfa2-46d7-a80c-989a6e106e70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:04.527507 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f83af44c-bfa2-46d7-a80c-989a6e106e70 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.151790 Jun 22 11:49:04.528333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 268/490] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:04 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:04.680482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1cec115f-f255-4e00-95fe-56fdbd065315 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:04.681073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1cec115f-f255-4e00-95fe-56fdbd065315 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:04.687181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1cec115f-f255-4e00-95fe-56fdbd065315 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:04.687701 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1cec115f-f255-4e00-95fe-56fdbd065315 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:04.688499 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1cec115f-f255-4e00-95fe-56fdbd065315 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:04.689032 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1cec115f-f255-4e00-95fe-56fdbd065315 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:04.822826 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1cec115f-f255-4e00-95fe-56fdbd065315 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:04.830580 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1cec115f-f255-4e00-95fe-56fdbd065315 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.153955 Jun 22 11:49:04.831467 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 269/491] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:04 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:05.549077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-63e82496-451f-4f5e-bb5a-67277c436c45 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:05.549803 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-63e82496-451f-4f5e-bb5a-67277c436c45 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:05.555684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-63e82496-451f-4f5e-bb5a-67277c436c45 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:05.556132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-63e82496-451f-4f5e-bb5a-67277c436c45 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:05.556888 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-63e82496-451f-4f5e-bb5a-67277c436c45 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:05.557323 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-63e82496-451f-4f5e-bb5a-67277c436c45 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:05.690419 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-63e82496-451f-4f5e-bb5a-67277c436c45 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:05.699231 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-63e82496-451f-4f5e-bb5a-67277c436c45 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.154020 Jun 22 11:49:05.699833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 270/492] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:05 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:05.848266 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-33881e06-0572-4366-80d7-bc518a377752 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:05.848899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-33881e06-0572-4366-80d7-bc518a377752 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:05.855522 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-33881e06-0572-4366-80d7-bc518a377752 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:05.855993 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-33881e06-0572-4366-80d7-bc518a377752 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:05.856776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-33881e06-0572-4366-80d7-bc518a377752 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:05.857210 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-33881e06-0572-4366-80d7-bc518a377752 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:05.995176 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-33881e06-0572-4366-80d7-bc518a377752 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:06.003001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-33881e06-0572-4366-80d7-bc518a377752 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.158527 Jun 22 11:49:06.003585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 271/493] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:05 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:06.719339 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3039cba9-dfca-49e9-8c30-c6c65a65242e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:06.720023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3039cba9-dfca-49e9-8c30-c6c65a65242e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:06.726259 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3039cba9-dfca-49e9-8c30-c6c65a65242e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:06.726692 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3039cba9-dfca-49e9-8c30-c6c65a65242e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:06.727486 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3039cba9-dfca-49e9-8c30-c6c65a65242e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:06.727918 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3039cba9-dfca-49e9-8c30-c6c65a65242e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:06.730959 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:49:06.860874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3039cba9-dfca-49e9-8c30-c6c65a65242e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:06.869245 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3039cba9-dfca-49e9-8c30-c6c65a65242e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.154750 Jun 22 11:49:06.870366 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 272/494] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:06 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:07.020878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3500d919-ff97-4f1c-bbc4-38cb3e4024ea tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:07.021409 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3500d919-ff97-4f1c-bbc4-38cb3e4024ea tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:07.027904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3500d919-ff97-4f1c-bbc4-38cb3e4024ea tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:07.028341 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3500d919-ff97-4f1c-bbc4-38cb3e4024ea tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:07.029099 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3500d919-ff97-4f1c-bbc4-38cb3e4024ea tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:07.029548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3500d919-ff97-4f1c-bbc4-38cb3e4024ea tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:07.158239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3500d919-ff97-4f1c-bbc4-38cb3e4024ea tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:07.165595 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3500d919-ff97-4f1c-bbc4-38cb3e4024ea tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.148715 Jun 22 11:49:07.166182 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 273/495] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:07 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:07.887368 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-826d9a88-ec91-4cac-aa8e-8428409167ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:07.888026 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-826d9a88-ec91-4cac-aa8e-8428409167ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:07.894299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-826d9a88-ec91-4cac-aa8e-8428409167ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:07.894744 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-826d9a88-ec91-4cac-aa8e-8428409167ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:07.895607 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-826d9a88-ec91-4cac-aa8e-8428409167ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:07.896041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-826d9a88-ec91-4cac-aa8e-8428409167ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:08.025029 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-826d9a88-ec91-4cac-aa8e-8428409167ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:08.033629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-826d9a88-ec91-4cac-aa8e-8428409167ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.150789 Jun 22 11:49:08.034191 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 274/496] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:07 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:08.182632 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-57fe1be8-7208-479f-a66e-55b468607b6b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:08.183230 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-57fe1be8-7208-479f-a66e-55b468607b6b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:08.189219 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-57fe1be8-7208-479f-a66e-55b468607b6b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:08.189660 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-57fe1be8-7208-479f-a66e-55b468607b6b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:08.190399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-57fe1be8-7208-479f-a66e-55b468607b6b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:08.190825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-57fe1be8-7208-479f-a66e-55b468607b6b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:08.330891 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-57fe1be8-7208-479f-a66e-55b468607b6b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:08.339332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-57fe1be8-7208-479f-a66e-55b468607b6b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.160473 Jun 22 11:49:08.340202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 275/497] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:08 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:08.442327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e7192aad-125d-4dfa-a1c5-a2dc7909c1d5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "POST /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.135295 Jun 22 11:49:08.443262 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 223/498] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 11:49:03 2022] POST /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments => generated 194 bytes in 5137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:49:09.050240 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fdc834cf-bc9e-465c-9228-e4bf835d86e1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:09.050892 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fdc834cf-bc9e-465c-9228-e4bf835d86e1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:09.057378 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fdc834cf-bc9e-465c-9228-e4bf835d86e1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:09.057829 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fdc834cf-bc9e-465c-9228-e4bf835d86e1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:09.058586 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fdc834cf-bc9e-465c-9228-e4bf835d86e1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:09.059016 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fdc834cf-bc9e-465c-9228-e4bf835d86e1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:09.193222 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fdc834cf-bc9e-465c-9228-e4bf835d86e1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:09.201676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fdc834cf-bc9e-465c-9228-e4bf835d86e1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.155186 Jun 22 11:49:09.202241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 276/499] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:09 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:09.357302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-429292f7-86eb-4c41-9dd4-25734b8cd3ee tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:09.357903 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-429292f7-86eb-4c41-9dd4-25734b8cd3ee tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:09.364054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-429292f7-86eb-4c41-9dd4-25734b8cd3ee tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:09.364488 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-429292f7-86eb-4c41-9dd4-25734b8cd3ee tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:09.365231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-429292f7-86eb-4c41-9dd4-25734b8cd3ee tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:09.365655 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-429292f7-86eb-4c41-9dd4-25734b8cd3ee tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:09.501890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-429292f7-86eb-4c41-9dd4-25734b8cd3ee tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:09.510226 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-429292f7-86eb-4c41-9dd4-25734b8cd3ee tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.157457 Jun 22 11:49:09.510928 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 224/500] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:09 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:10.220598 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d441457d-4d3b-44fb-931c-012d77ce25a0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:10.222586 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d441457d-4d3b-44fb-931c-012d77ce25a0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:10.229987 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d441457d-4d3b-44fb-931c-012d77ce25a0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:10.230648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d441457d-4d3b-44fb-931c-012d77ce25a0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:10.231900 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d441457d-4d3b-44fb-931c-012d77ce25a0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:10.232557 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d441457d-4d3b-44fb-931c-012d77ce25a0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:10.250548 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-15f3d7c9-d545-490f-be25-8e696bfdfc3d req-048d42fc-78f1-47c3-a8bc-6d4f208d568c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3eb4a54-d3df-4eca-b1ef-3dcb13716d61", "name": "network-vif-plugged", "status": "completed", "tag": "372fe7e2-a11e-410a-ad0b-3ed41c865845"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:49:10.272397 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-15f3d7c9-d545-490f-be25-8e696bfdfc3d req-048d42fc-78f1-47c3-a8bc-6d4f208d568c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:10.272832 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-15f3d7c9-d545-490f-be25-8e696bfdfc3d req-048d42fc-78f1-47c3-a8bc-6d4f208d568c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:10.290105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-15f3d7c9-d545-490f-be25-8e696bfdfc3d req-048d42fc-78f1-47c3-a8bc-6d4f208d568c service nova] Creating event network-vif-plugged:372fe7e2-a11e-410a-ad0b-3ed41c865845 for instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 on hv-cinder-83697 Jun 22 11:49:10.295189 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-15f3d7c9-d545-490f-be25-8e696bfdfc3d req-048d42fc-78f1-47c3-a8bc-6d4f208d568c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058126 Jun 22 11:49:10.296138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 225/501] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:49:10.371709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d441457d-4d3b-44fb-931c-012d77ce25a0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:10.379735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d441457d-4d3b-44fb-931c-012d77ce25a0 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.163434 Jun 22 11:49:10.380292 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 277/502] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:10 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:10.528231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-15b3f1a6-4d9c-40f5-8121-1d6d7ea08cf2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:10.528830 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-15b3f1a6-4d9c-40f5-8121-1d6d7ea08cf2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:10.535809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-15b3f1a6-4d9c-40f5-8121-1d6d7ea08cf2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:10.536252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-15b3f1a6-4d9c-40f5-8121-1d6d7ea08cf2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:10.537264 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-15b3f1a6-4d9c-40f5-8121-1d6d7ea08cf2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:10.537694 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-15b3f1a6-4d9c-40f5-8121-1d6d7ea08cf2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:10.695770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-15b3f1a6-4d9c-40f5-8121-1d6d7ea08cf2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:10.703842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-15b3f1a6-4d9c-40f5-8121-1d6d7ea08cf2 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.180660 Jun 22 11:49:10.704401 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 226/503] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:10 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:11.397368 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e95c53d6-04d2-4d2f-b49b-2f187a2cc81b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:11.397971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e95c53d6-04d2-4d2f-b49b-2f187a2cc81b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:11.399848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:49:11.405396 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e95c53d6-04d2-4d2f-b49b-2f187a2cc81b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:11.405835 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e95c53d6-04d2-4d2f-b49b-2f187a2cc81b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:11.406589 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e95c53d6-04d2-4d2f-b49b-2f187a2cc81b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:11.407020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e95c53d6-04d2-4d2f-b49b-2f187a2cc81b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:11.538449 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e95c53d6-04d2-4d2f-b49b-2f187a2cc81b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:11.546409 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e95c53d6-04d2-4d2f-b49b-2f187a2cc81b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.152747 Jun 22 11:49:11.546968 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 278/504] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:11 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:11.721122 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9acb1371-8d37-4b89-90d8-fdc64f3bccbd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:11.721707 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9acb1371-8d37-4b89-90d8-fdc64f3bccbd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:11.728360 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9acb1371-8d37-4b89-90d8-fdc64f3bccbd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:11.728785 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9acb1371-8d37-4b89-90d8-fdc64f3bccbd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:11.729533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9acb1371-8d37-4b89-90d8-fdc64f3bccbd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:11.729957 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9acb1371-8d37-4b89-90d8-fdc64f3bccbd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:11.863125 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9acb1371-8d37-4b89-90d8-fdc64f3bccbd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:11.870671 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9acb1371-8d37-4b89-90d8-fdc64f3bccbd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.153873 Jun 22 11:49:11.871222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 227/505] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:11 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:12.564474 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-80d9ebc9-509f-4dd4-bce9-0e64d389ec0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:12.565079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-80d9ebc9-509f-4dd4-bce9-0e64d389ec0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:12.570922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80d9ebc9-509f-4dd4-bce9-0e64d389ec0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:12.571376 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80d9ebc9-509f-4dd4-bce9-0e64d389ec0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:12.572131 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80d9ebc9-509f-4dd4-bce9-0e64d389ec0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:12.572592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80d9ebc9-509f-4dd4-bce9-0e64d389ec0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:12.703987 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-80d9ebc9-509f-4dd4-bce9-0e64d389ec0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:12.711977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-80d9ebc9-509f-4dd4-bce9-0e64d389ec0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.151800 Jun 22 11:49:12.712767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 279/506] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:12 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:12.887472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-653644be-bec2-4f2c-ad35-7a607fd8b8b8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:12.888075 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-653644be-bec2-4f2c-ad35-7a607fd8b8b8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:12.894764 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-653644be-bec2-4f2c-ad35-7a607fd8b8b8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:12.895210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-653644be-bec2-4f2c-ad35-7a607fd8b8b8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:12.895997 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-653644be-bec2-4f2c-ad35-7a607fd8b8b8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:12.896420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-653644be-bec2-4f2c-ad35-7a607fd8b8b8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:12.900397 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:49:13.032507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-653644be-bec2-4f2c-ad35-7a607fd8b8b8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:13.040190 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-653644be-bec2-4f2c-ad35-7a607fd8b8b8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1260 microversion: 2.1 time: 0.156608 Jun 22 11:49:13.040749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 228/507] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:12 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:13.730324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d2736d20-8739-40ce-828c-5efb865afdb9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:13.731238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d2736d20-8739-40ce-828c-5efb865afdb9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:13.737593 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d2736d20-8739-40ce-828c-5efb865afdb9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:13.738155 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d2736d20-8739-40ce-828c-5efb865afdb9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:13.739073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d2736d20-8739-40ce-828c-5efb865afdb9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:13.740099 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d2736d20-8739-40ce-828c-5efb865afdb9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:13.884652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d2736d20-8739-40ce-828c-5efb865afdb9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:13.894066 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d2736d20-8739-40ce-828c-5efb865afdb9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.168281 Jun 22 11:49:13.894647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 280/508] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:13 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:14.058089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-96f5e87b-380c-46a0-9a16-fa2075f9dd76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:14.058756 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-96f5e87b-380c-46a0-9a16-fa2075f9dd76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:14.065967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-96f5e87b-380c-46a0-9a16-fa2075f9dd76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:14.066495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-96f5e87b-380c-46a0-9a16-fa2075f9dd76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:14.067644 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-96f5e87b-380c-46a0-9a16-fa2075f9dd76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:14.068122 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-96f5e87b-380c-46a0-9a16-fa2075f9dd76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:14.213078 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-96f5e87b-380c-46a0-9a16-fa2075f9dd76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:14.221410 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-96f5e87b-380c-46a0-9a16-fa2075f9dd76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1444 microversion: 2.1 time: 0.167540 Jun 22 11:49:14.222111 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 229/509] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:14 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:14.238710 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4beb0036-fe7c-4541-8f84-c5eb20573c1a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:14.239368 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4beb0036-fe7c-4541-8f84-c5eb20573c1a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:14.245251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4beb0036-fe7c-4541-8f84-c5eb20573c1a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:14.245698 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4beb0036-fe7c-4541-8f84-c5eb20573c1a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:14.246445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4beb0036-fe7c-4541-8f84-c5eb20573c1a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:14.246868 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4beb0036-fe7c-4541-8f84-c5eb20573c1a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:14.387383 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4beb0036-fe7c-4541-8f84-c5eb20573c1a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:14.395171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4beb0036-fe7c-4541-8f84-c5eb20573c1a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1444 microversion: 2.1 time: 0.160312 Jun 22 11:49:14.395775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 281/510] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:14 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:14.911913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4e4121d1-85f0-4864-bd51-cc6cd8b9603f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:14.912522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4e4121d1-85f0-4864-bd51-cc6cd8b9603f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:14.918612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e4121d1-85f0-4864-bd51-cc6cd8b9603f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:14.919058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e4121d1-85f0-4864-bd51-cc6cd8b9603f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:14.919886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e4121d1-85f0-4864-bd51-cc6cd8b9603f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:14.920321 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e4121d1-85f0-4864-bd51-cc6cd8b9603f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:15.071830 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4e4121d1-85f0-4864-bd51-cc6cd8b9603f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:15.081688 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4e4121d1-85f0-4864-bd51-cc6cd8b9603f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.173301 Jun 22 11:49:15.093544 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 230/511] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:14 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:49:16.099578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-40e80946-82e0-41ab-a137-0338096ebb26 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:16.100200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-40e80946-82e0-41ab-a137-0338096ebb26 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:16.106109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-40e80946-82e0-41ab-a137-0338096ebb26 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:16.106551 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-40e80946-82e0-41ab-a137-0338096ebb26 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:16.107294 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-40e80946-82e0-41ab-a137-0338096ebb26 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:16.107738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-40e80946-82e0-41ab-a137-0338096ebb26 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:16.240402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-40e80946-82e0-41ab-a137-0338096ebb26 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:16.248968 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-40e80946-82e0-41ab-a137-0338096ebb26 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.153247 Jun 22 11:49:16.249526 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 282/512] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:16 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:16.447941 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-a447b3f3-456f-4639-ac24-7d59bb6262bb req-d0fca361-7105-4730-b9a1-f3f6954253ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3eb4a54-d3df-4eca-b1ef-3dcb13716d61", "tag": "372fe7e2-a11e-410a-ad0b-3ed41c865845"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:49:16.456481 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-a447b3f3-456f-4639-ac24-7d59bb6262bb req-d0fca361-7105-4730-b9a1-f3f6954253ce service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:16.456909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-a447b3f3-456f-4639-ac24-7d59bb6262bb req-d0fca361-7105-4730-b9a1-f3f6954253ce service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:16.467873 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-a447b3f3-456f-4639-ac24-7d59bb6262bb req-d0fca361-7105-4730-b9a1-f3f6954253ce service nova] Creating event network-changed:372fe7e2-a11e-410a-ad0b-3ed41c865845 for instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 on hv-cinder-83697 Jun 22 11:49:16.472829 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-a447b3f3-456f-4639-ac24-7d59bb6262bb req-d0fca361-7105-4730-b9a1-f3f6954253ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028606 Jun 22 11:49:16.473391 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 231/513] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:49:17.103633 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f467b887-9249-446d-858d-2f7151df8612 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:17.104370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f467b887-9249-446d-858d-2f7151df8612 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:17.111643 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f467b887-9249-446d-858d-2f7151df8612 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:17.112940 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f467b887-9249-446d-858d-2f7151df8612 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:17.114523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f467b887-9249-446d-858d-2f7151df8612 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:17.115156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f467b887-9249-446d-858d-2f7151df8612 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:17.268712 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f467b887-9249-446d-858d-2f7151df8612 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:17.273190 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c7453cf8-47c5-4270-9e5d-f28fe6693f79 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:17.274139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c7453cf8-47c5-4270-9e5d-f28fe6693f79 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:17.279546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f467b887-9249-446d-858d-2f7151df8612 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1595 microversion: 2.1 time: 0.179564 Jun 22 11:49:17.280134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 283/514] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:17 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1595 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:17.281173 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c7453cf8-47c5-4270-9e5d-f28fe6693f79 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:17.281621 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c7453cf8-47c5-4270-9e5d-f28fe6693f79 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:17.282377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c7453cf8-47c5-4270-9e5d-f28fe6693f79 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:17.282808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c7453cf8-47c5-4270-9e5d-f28fe6693f79 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:17.458114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c7453cf8-47c5-4270-9e5d-f28fe6693f79 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:17.467950 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c7453cf8-47c5-4270-9e5d-f28fe6693f79 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.204899 Jun 22 11:49:17.479462 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 232/515] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:17 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:18.486757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d81e05b4-311e-4de9-ac51-a515ed90c16a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:18.487435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d81e05b4-311e-4de9-ac51-a515ed90c16a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:18.493315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d81e05b4-311e-4de9-ac51-a515ed90c16a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:18.493754 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d81e05b4-311e-4de9-ac51-a515ed90c16a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:18.494661 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d81e05b4-311e-4de9-ac51-a515ed90c16a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:18.495164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d81e05b4-311e-4de9-ac51-a515ed90c16a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:18.644184 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d81e05b4-311e-4de9-ac51-a515ed90c16a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:18.654173 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d81e05b4-311e-4de9-ac51-a515ed90c16a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.171135 Jun 22 11:49:18.655070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 284/516] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:18 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:19.150778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-c303e53b-e50b-4f1e-b9fa-5b4e912c2460 req-1e05bf83-cab2-43e3-8550-fe6dcef63a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3e9cd1-e3da-436f-a4e7-f6c953c83df4", "tag": "a4726067-df3c-4a9b-939a-61e6fd9345db"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:49:19.154719 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=50 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:49:19.179596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-c303e53b-e50b-4f1e-b9fa-5b4e912c2460 req-1e05bf83-cab2-43e3-8550-fe6dcef63a55 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:19.180041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-c303e53b-e50b-4f1e-b9fa-5b4e912c2460 req-1e05bf83-cab2-43e3-8550-fe6dcef63a55 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:19.192643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-c303e53b-e50b-4f1e-b9fa-5b4e912c2460 req-1e05bf83-cab2-43e3-8550-fe6dcef63a55 service nova] Creating event network-changed:a4726067-df3c-4a9b-939a-61e6fd9345db for instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 on hv-cinder-83697 Jun 22 11:49:19.199214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-c303e53b-e50b-4f1e-b9fa-5b4e912c2460 req-1e05bf83-cab2-43e3-8550-fe6dcef63a55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052307 Jun 22 11:49:19.203757 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 233/517] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:49:19.673691 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-89d0da63-2a90-43ac-8891-7dcfaa2fadab tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:19.674943 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-89d0da63-2a90-43ac-8891-7dcfaa2fadab tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:19.683406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-89d0da63-2a90-43ac-8891-7dcfaa2fadab tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:19.684148 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-89d0da63-2a90-43ac-8891-7dcfaa2fadab tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:19.685155 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-89d0da63-2a90-43ac-8891-7dcfaa2fadab tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:19.685840 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-89d0da63-2a90-43ac-8891-7dcfaa2fadab tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:19.894392 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-89d0da63-2a90-43ac-8891-7dcfaa2fadab tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:19.905845 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-89d0da63-2a90-43ac-8891-7dcfaa2fadab tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1702 microversion: 2.1 time: 0.236647 Jun 22 11:49:19.906465 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 285/518] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:19 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1702 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:19.923918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8d6b3ca4-1524-4b5d-8333-b810381e1693 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:49:19.930411 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8d6b3ca4-1524-4b5d-8333-b810381e1693 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:19.931116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8d6b3ca4-1524-4b5d-8333-b810381e1693 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:19.960348 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8d6b3ca4-1524-4b5d-8333-b810381e1693 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Going to try to start instance {{(pid=129527) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 11:49:20.017340 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8d6b3ca4-1524-4b5d-8333-b810381e1693 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/action" status: 202 len: 0 microversion: 2.1 time: 0.092193 Jun 22 11:49:20.018057 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 234/519] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:49:19 2022] POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:49:20.026174 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-31211e0a-03a9-4913-b710-753a9be38d05 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:20.029630 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-31211e0a-03a9-4913-b710-753a9be38d05 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:20.041891 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-31211e0a-03a9-4913-b710-753a9be38d05 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:20.042384 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-31211e0a-03a9-4913-b710-753a9be38d05 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:20.043334 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-31211e0a-03a9-4913-b710-753a9be38d05 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:20.043749 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-31211e0a-03a9-4913-b710-753a9be38d05 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:20.277318 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-31211e0a-03a9-4913-b710-753a9be38d05 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:20.286673 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-31211e0a-03a9-4913-b710-753a9be38d05 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1711 microversion: 2.1 time: 0.264320 Jun 22 11:49:20.287527 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 286/520] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:20 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1711 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:20.403968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9b321382-042c-433a-a273-7cf274a9fac7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1200915113"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:49:20.404618 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9b321382-042c-433a-a273-7cf274a9fac7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:20.411310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9b321382-042c-433a-a273-7cf274a9fac7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:20.411779 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9b321382-042c-433a-a273-7cf274a9fac7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:20.412547 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9b321382-042c-433a-a273-7cf274a9fac7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:20.412980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9b321382-042c-433a-a273-7cf274a9fac7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:20.547886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.network.security_group_api [None req-9b321382-042c-433a-a273-7cf274a9fac7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Adding security group 232c239a-258f-44e0-8358-447027d11f03 to port a4726067-df3c-4a9b-939a-61e6fd9345db Jun 22 11:49:20.920970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9b321382-042c-433a-a273-7cf274a9fac7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "POST /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/action" status: 202 len: 0 microversion: 2.1 time: 0.522263 Jun 22 11:49:20.921855 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 235/521] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:49:20 2022] POST /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:49:20.930240 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-012b9ea5-d14a-4aca-86d6-ac4280e11404 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:20.932871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-012b9ea5-d14a-4aca-86d6-ac4280e11404 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:20.939642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-012b9ea5-d14a-4aca-86d6-ac4280e11404 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:20.940313 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-012b9ea5-d14a-4aca-86d6-ac4280e11404 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:20.941250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-012b9ea5-d14a-4aca-86d6-ac4280e11404 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:20.941861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-012b9ea5-d14a-4aca-86d6-ac4280e11404 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:20.957093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-33b6e50f-f393-4717-9b77-ff0e8cdba8a7 req-b547c386-0f5a-4b23-b769-0acb40c801b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3e9cd1-e3da-436f-a4e7-f6c953c83df4", "tag": "a4726067-df3c-4a9b-939a-61e6fd9345db"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:49:20.975095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-33b6e50f-f393-4717-9b77-ff0e8cdba8a7 req-b547c386-0f5a-4b23-b769-0acb40c801b8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:20.975572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-33b6e50f-f393-4717-9b77-ff0e8cdba8a7 req-b547c386-0f5a-4b23-b769-0acb40c801b8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:21.002551 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-33b6e50f-f393-4717-9b77-ff0e8cdba8a7 req-b547c386-0f5a-4b23-b769-0acb40c801b8 service nova] Creating event network-changed:a4726067-df3c-4a9b-939a-61e6fd9345db for instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 on hv-cinder-83697 Jun 22 11:49:21.009886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-33b6e50f-f393-4717-9b77-ff0e8cdba8a7 req-b547c386-0f5a-4b23-b769-0acb40c801b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061515 Jun 22 11:49:21.015167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 236/522] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:49:21.173735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-012b9ea5-d14a-4aca-86d6-ac4280e11404 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:21.182248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-012b9ea5-d14a-4aca-86d6-ac4280e11404 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1761 microversion: 2.1 time: 0.256163 Jun 22 11:49:21.183424 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 287/523] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:20 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1761 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:21.305569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-daf69cb1-4b32-4e44-ad4d-37dee915de49 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:21.306399 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-daf69cb1-4b32-4e44-ad4d-37dee915de49 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:21.312982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-daf69cb1-4b32-4e44-ad4d-37dee915de49 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:21.314693 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-daf69cb1-4b32-4e44-ad4d-37dee915de49 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:21.315604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-daf69cb1-4b32-4e44-ad4d-37dee915de49 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:21.316108 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-daf69cb1-4b32-4e44-ad4d-37dee915de49 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:21.451557 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-daf69cb1-4b32-4e44-ad4d-37dee915de49 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:21.459617 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-daf69cb1-4b32-4e44-ad4d-37dee915de49 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1711 microversion: 2.1 time: 0.158198 Jun 22 11:49:21.461295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 237/524] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:21 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:49:22.478746 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8c4fa8f5-292a-4e25-b9cb-285372c5083a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:49:22.479381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8c4fa8f5-292a-4e25-b9cb-285372c5083a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:49:22.485405 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8c4fa8f5-292a-4e25-b9cb-285372c5083a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:22.485844 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8c4fa8f5-292a-4e25-b9cb-285372c5083a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:22.486588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8c4fa8f5-292a-4e25-b9cb-285372c5083a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:49:22.487015 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8c4fa8f5-292a-4e25-b9cb-285372c5083a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:49:22.619597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8c4fa8f5-292a-4e25-b9cb-285372c5083a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:49:22.621853 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:49:22.629444 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8c4fa8f5-292a-4e25-b9cb-285372c5083a tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1715 microversion: 2.1 time: 0.155326 Jun 22 11:49:22.630009 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 288/525] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:49:22 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:50:01.673272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-04efcbc7-a4ce-42eb-bddf-8d6bf5c92a80 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:01.673870 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-04efcbc7-a4ce-42eb-bddf-8d6bf5c92a80 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:01.676070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=9 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:50:01.676714 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:50:01.682457 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-04efcbc7-a4ce-42eb-bddf-8d6bf5c92a80 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:01.682892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-04efcbc7-a4ce-42eb-bddf-8d6bf5c92a80 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:01.683676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-04efcbc7-a4ce-42eb-bddf-8d6bf5c92a80 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:01.684105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-04efcbc7-a4ce-42eb-bddf-8d6bf5c92a80 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:01.708367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-04efcbc7-a4ce-42eb-bddf-8d6bf5c92a80 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/ips" status: 200 len: 151 microversion: 2.20 time: 0.039097 Jun 22 11:50:01.708928 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 238/526] 10.222.0.36 () {60 vars in 1288 bytes} [Wed Jun 22 11:50:01 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:50:04.832207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a6f6dbb6-995f-4d89-a157-3f184ef20a98 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:50:04.832794 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a6f6dbb6-995f-4d89-a157-3f184ef20a98 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:04.834784 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=59 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:50:04.835434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:50:04.841291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a6f6dbb6-995f-4d89-a157-3f184ef20a98 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:04.841732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a6f6dbb6-995f-4d89-a157-3f184ef20a98 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:04.842488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a6f6dbb6-995f-4d89-a157-3f184ef20a98 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:04.842913 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a6f6dbb6-995f-4d89-a157-3f184ef20a98 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:04.869948 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-a6f6dbb6-995f-4d89-a157-3f184ef20a98 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lazy-loading 'flavor' on Instance uuid f5b85599-217c-4d95-a8ef-136d2368cf70 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:50:05.165066 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a6f6dbb6-995f-4d89-a157-3f184ef20a98 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/action" status: 202 len: 0 microversion: 2.20 time: 0.336550 Jun 22 11:50:05.165862 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 289/527] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Jun 22 11:50:04 2022] POST /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:50:05.173956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:05.175255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:05.181717 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:05.182164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:05.182921 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:05.183368 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:05.316263 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:05.324071 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:05.325559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:05.326695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-938a1901-2aa1-4177-a3ed-fc9062c47426 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.156656 Jun 22 11:50:05.327255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 239/528] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:05 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:06.345866 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:06.347092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:06.353550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:06.353986 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:06.354746 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:06.355177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:06.496578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:06.504934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:06.506441 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:06.507631 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4e84fcac-b61b-4262-a0ff-e73dec391e96 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.166306 Jun 22 11:50:06.508526 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 290/529] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:06 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:07.527530 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:07.528127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:07.535486 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:07.535962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:07.536880 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:07.537316 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:07.668700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:07.676511 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:07.678513 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:07.680256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-dfa47e19-6ac8-44c5-b4f1-86bb27cadc89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.156601 Jun 22 11:50:07.680948 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 240/530] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:07 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:08.698812 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:08.699405 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:08.705451 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:08.705892 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:08.706670 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:08.707640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:08.838493 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:08.846457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:08.848509 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:08.849674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-48f911f8-8057-49d5-a74d-079074fb1e84 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.154810 Jun 22 11:50:08.850287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 291/531] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:08 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:09.868269 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:09.868871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:09.875686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:09.876134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:09.876888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:09.877319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:10.133877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:10.141913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:10.143413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:10.144568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-fd27dba3-9a1a-4a67-b794-a8908bcd001b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.280196 Jun 22 11:50:10.145113 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 241/532] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:09 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:11.163855 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:11.164488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:11.170444 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:11.170888 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:11.171669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:11.172104 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:11.349257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:11.358903 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:11.360482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:11.361637 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-26972aae-731f-4200-b72e-565ade52fc7e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.202197 Jun 22 11:50:11.362194 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 292/533] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:11 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:12.380714 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:12.381552 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:12.388009 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:12.388448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:12.389303 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:12.389731 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:12.522568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:12.530627 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:12.532156 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:12.533300 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-70dc2d67-d018-48b6-8c4c-62040a594881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.157158 Jun 22 11:50:12.533856 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 242/534] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:12 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:13.551731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:13.552480 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:13.558344 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:13.558785 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:13.559570 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:13.560000 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:13.685220 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:13.693610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:13.695090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:13.696249 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1bb9cc1b-3230-4e50-833d-47542a0ed9d2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.148619 Jun 22 11:50:13.696806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 293/535] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:13 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:14.715090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:14.715720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:14.722207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:14.722655 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:14.723707 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:14.724101 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:14.861456 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:14.869851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:14.871325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:14.872578 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-cefb1cb7-e186-4b62-b1ec-6c945f237701 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.161413 Jun 22 11:50:14.873129 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 243/536] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:14 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:15.057162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 11:50:15.057731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Wed Jun 22 11:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 11:50:15.892367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:15.892960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:15.899054 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:15.899649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:15.900449 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:15.900906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:16.031370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:16.039874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:16.041369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:16.042508 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9959ddac-72e8-4eed-96b8-3a1d53288d20 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.154388 Jun 22 11:50:16.043058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 294/537] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:15 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:17.060484 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:17.061085 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:17.067542 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:17.067979 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:17.069238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:17.069666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:17.195108 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:17.202959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:17.204496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:17.205639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-11ba2533-5ebc-4f8a-858d-81ac7115b5dd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.149055 Jun 22 11:50:17.206201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 244/538] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:17 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:18.224831 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:18.225369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:18.231324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:18.231802 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:18.232554 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:18.233027 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:18.361701 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:18.370221 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:18.371768 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:18.372905 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cec32150-a4a5-44a0-970e-eead95568e48 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.152140 Jun 22 11:50:18.373452 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 295/539] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:18 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:18.639182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 11:50:18.639738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 11:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 11:50:19.392593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:19.393177 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:19.399809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:19.400252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:19.401008 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:19.401437 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:19.528201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:19.536236 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:19.537758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:19.539504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4f38600f-cba0-46c3-9af1-143d2f5ebbb2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.151375 Jun 22 11:50:19.540056 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 245/540] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:19 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:20.558679 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:20.559264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:20.565275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:20.565717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:20.566467 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:20.566896 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:20.696568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:20.704527 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:20.706067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:20.707211 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a1951338-21af-466d-b0b7-193f2633f074 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.152434 Jun 22 11:50:20.707787 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 296/541] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:20 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:21.725876 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:21.726494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:21.732850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:21.733290 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:21.734032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:21.734461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:21.862145 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:21.869923 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:21.871452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:21.872585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-abc1fb09-e3d9-49ff-bdab-332d79e41e31 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.151584 Jun 22 11:50:21.873128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 246/542] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:21 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:22.890016 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:22.890876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:22.897208 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:22.897642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:22.898387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:22.898805 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:23.028982 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:23.040620 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:23.042147 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:23.043613 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7a8d60d1-9bf8-443a-ba9b-ce909095330f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.157317 Jun 22 11:50:23.044867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 297/543] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:22 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:24.063692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:24.064416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:24.071286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:24.071749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:24.072503 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:24.072931 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:24.198763 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:24.206533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:24.208041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:24.209165 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-451f5750-bc9c-495f-a28b-2351cd7e66cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.149701 Jun 22 11:50:24.209709 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 247/544] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:24 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:25.227836 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:25.228495 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:25.234427 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:25.234875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:25.235651 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:25.236082 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:25.364909 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:25.373370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:25.374879 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:25.376055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-19e7dbb7-9f8f-4159-9e06-53b96028cfd9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.152194 Jun 22 11:50:25.376646 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 298/545] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:25 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:26.394612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:26.395215 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:26.402138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:26.402576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:26.403324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:26.403777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:26.536281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:26.545372 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:26.546860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:26.548030 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2830e683-3345-4db6-88d6-09e743349ee5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.157349 Jun 22 11:50:26.548666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 248/546] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:26 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:27.119317 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 11:50:27.119652 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 11:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 11:50:27.566267 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:27.566884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:27.572925 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:27.573368 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:27.574118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:27.574546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:27.701204 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:27.709140 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:27.710647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:27.711811 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-984611c1-83ae-4825-8f0d-4e705a5d88e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.149432 Jun 22 11:50:27.712361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 299/547] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:27 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:28.729940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:28.730572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:28.737026 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:28.737471 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:28.738225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:28.738655 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:28.831985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-f20e5463-1df9-49bf-b338-1e8d6569b635 req-2b4b11fa-89b5-4df0-9774-ae6ef592d55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b85599-217c-4d95-a8ef-136d2368cf70", "name": "network-vif-plugged", "status": "completed", "tag": "4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:50:28.840543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-f20e5463-1df9-49bf-b338-1e8d6569b635 req-2b4b11fa-89b5-4df0-9774-ae6ef592d55a service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:28.841054 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-f20e5463-1df9-49bf-b338-1e8d6569b635 req-2b4b11fa-89b5-4df0-9774-ae6ef592d55a service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:28.853619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-f20e5463-1df9-49bf-b338-1e8d6569b635 req-2b4b11fa-89b5-4df0-9774-ae6ef592d55a service nova] Creating event network-vif-plugged:4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6 for instance f5b85599-217c-4d95-a8ef-136d2368cf70 on hv-cinder-83697 Jun 22 11:50:28.858737 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-f20e5463-1df9-49bf-b338-1e8d6569b635 req-2b4b11fa-89b5-4df0-9774-ae6ef592d55a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030473 Jun 22 11:50:28.859958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 300/548] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:50:28.876457 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:28.885046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:28.886737 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:28.888170 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-204e67bf-4352-40f3-8057-86dcaca69d8d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.162061 Jun 22 11:50:28.888790 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 249/549] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:28 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:29.907276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:29.908008 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:29.914192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:29.914667 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:29.915446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:29.915881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:30.049688 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:30.058474 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:30.060005 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:30.061138 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a38f54a4-68cf-4de7-b28f-a4240bdee881 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.158104 Jun 22 11:50:30.061717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 301/550] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:29 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:31.080094 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:31.080816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:31.087851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:31.088283 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:31.089031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:31.089453 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:31.214225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:31.221939 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:31.223471 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:31.224601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3d46c6cf-b8d1-4063-a8ea-bba6c549c248 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.148425 Jun 22 11:50:31.225149 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 250/551] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:31 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:32.242625 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:32.243226 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:32.249363 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:32.249808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:32.250563 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:32.250993 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:32.380427 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:32.388835 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:32.390584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:32.391749 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a2e60627-8e68-4448-8284-7937fba040db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.153598 Jun 22 11:50:32.392296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 302/552] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:32 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:33.410142 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:33.410713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:33.413028 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=27 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:50:33.418966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:33.419432 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:33.420182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:33.420605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:33.423448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=77 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:50:33.548217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:33.556740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:33.558226 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:33.559599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e26b0cde-6235-4cbb-90fe-fa0ea531b429 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1744 microversion: 2.20 time: 0.153206 Jun 22 11:50:33.560145 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 251/553] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:33 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:34.581951 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:34.582895 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:34.594390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:34.595452 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:34.596457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:34.596881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:34.746937 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:34.756097 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:34.757752 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:34.759081 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0f670dc5-3c60-4744-b903-9444cdeede4f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.183904 Jun 22 11:50:34.759649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 303/554] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:34 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:35.780206 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:35.780886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:35.787972 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:35.788564 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:35.789382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:35.789860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:35.955246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:35.965599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:35.966658 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:35.967933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-aecae9d6-b3f1-43aa-a82f-6e21f349c2e1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.193299 Jun 22 11:50:35.969108 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 252/555] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:35 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:36.987374 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:36.988009 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:36.989915 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=31 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:50:36.995555 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:36.995996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:36.996813 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:36.997242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:36.999963 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:50:37.162545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:37.171542 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:37.173077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:37.174225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-80a4f9be-be8a-4ad5-b921-442b012ae4c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.190979 Jun 22 11:50:37.185556 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 304/556] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:36 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:38.204722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:38.205852 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:38.222073 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:38.222943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:38.224773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:38.226293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:38.635827 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:38.646702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:38.648925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:38.649954 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-271ff089-7dd8-4320-8d1f-3e74a0b71bbe tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.457772 Jun 22 11:50:38.650520 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 253/557] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:38 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:50:39.669215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:39.670011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:39.677335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:39.677659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:39.678437 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:39.680817 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:39.814520 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:39.822684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:39.824264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:39.825367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6bf7794d-499b-499e-b901-e913813687d9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.160033 Jun 22 11:50:39.825950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 305/558] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:39 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:40.844593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:40.845625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:40.853320 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:40.853770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:40.854536 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:40.854959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:40.996682 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:41.005605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:41.007785 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:41.008891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-530a8473-2119-442f-87f6-fcbb80df0558 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.168458 Jun 22 11:50:41.009449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 254/559] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:40 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:42.028333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:42.028944 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:42.035989 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:42.036487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:42.037256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:42.037682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:42.179727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:42.187739 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:42.189240 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:42.190809 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9eea24c2-50be-423d-a3fe-b36fdc46aa60 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.165890 Jun 22 11:50:42.190981 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 306/560] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:42 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:43.208394 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:43.209111 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:43.216507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:43.216949 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:43.217703 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:43.218128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:43.363420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:43.376052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:43.377800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:43.378979 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-13279611-9942-413e-a308-d4a21770ae83 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.174834 Jun 22 11:50:43.379913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 255/561] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:43 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:44.397848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:44.398452 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:44.404700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:44.405135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:44.405919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:44.406369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:44.547551 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:44.555906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:44.557383 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:44.558510 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0d229a46-efe5-4152-874b-cb2e6e4bf5c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.164584 Jun 22 11:50:44.559058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 307/562] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:44 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:45.580049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:45.580049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:45.586803 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:45.587585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:45.588369 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:45.589452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:45.742295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:45.750624 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:45.752417 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:45.753543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-70ef4fae-15f9-4f6f-b496-a48f42760891 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.179411 Jun 22 11:50:45.754091 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 256/563] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:45 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:46.773377 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:46.773996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:46.780051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:46.780506 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:46.781276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:46.781728 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:46.917423 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:46.925584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:46.927155 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:46.928343 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7d8dc93b-f36a-4809-876e-e53ef26c1d8b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.159452 Jun 22 11:50:46.928901 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 308/564] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:46 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:47.949379 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:47.950360 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:47.961085 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:47.961531 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:47.962304 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:47.962733 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:48.111014 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:48.119639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:48.121190 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:48.122327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-057eaaab-e226-4388-b138-05e6547f1e69 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.179867 Jun 22 11:50:48.122886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 257/565] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:47 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:49.143758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:49.144391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:49.151186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:49.152081 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:49.152874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:49.153310 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:49.292548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:49.301731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:49.303317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:49.305139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3e5e3a67-f4bd-4ba1-a35f-14330cbe7fae tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.165753 Jun 22 11:50:49.305700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 309/566] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:49 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:50:50.323800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:50.325133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:50.332102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:50.332640 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:50.333495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:50.333971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:50.482718 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:50.491242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:50.493118 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:50.494592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-355c933c-927a-4e6e-b14f-ec8188bc9949 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.174865 Jun 22 11:50:50.495153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 258/567] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:50 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:51.514530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:51.515382 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:51.521077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:51.521521 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:51.522278 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:51.522705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:51.654367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:51.662204 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:51.664203 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:51.665324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-20c5f1ad-f811-49bb-97ce-ed17ca71601f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1739 microversion: 2.20 time: 0.155246 Jun 22 11:50:51.665864 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 310/568] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:51 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:51.878340 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-61754f1d-0b8c-47b3-bd79-d0fad0c70db3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81de4c09-8497-4418-9d87-8dcad11969c4"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:50:51.879486 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-61754f1d-0b8c-47b3-bd79-d0fad0c70db3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:51.885341 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-61754f1d-0b8c-47b3-bd79-d0fad0c70db3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:51.885784 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-61754f1d-0b8c-47b3-bd79-d0fad0c70db3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:51.886537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-61754f1d-0b8c-47b3-bd79-d0fad0c70db3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:51.886965 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-61754f1d-0b8c-47b3-bd79-d0fad0c70db3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:52.353761 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-61754f1d-0b8c-47b3-bd79-d0fad0c70db3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582200 Jun 22 11:50:52.354413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 259/569] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 11:50:51 2022] POST /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:50:52.684345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:52.684943 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:52.690945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:52.691409 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:52.692161 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:52.692585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:52.828794 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:52.836815 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:52.838297 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:52.839458 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-565625c0-dda6-4717-bd7a-ce287842472a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1721 microversion: 2.20 time: 0.158923 Jun 22 11:50:52.839999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 311/570] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:52 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:50:53.859293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:53.859952 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:53.867520 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:53.867956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:53.868816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:53.869238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:53.997266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:54.005052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:54.006527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:54.007723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-41787fbf-dc09-4fda-9d65-d7633b7e466a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1721 microversion: 2.20 time: 0.152833 Jun 22 11:50:54.008274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 260/571] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:53 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:54.971793 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-70c9ede9-2d97-4331-8489-739c854932b0 req-283b5be5-9acc-404c-9063-d99059237fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b85599-217c-4d95-a8ef-136d2368cf70", "name": "network-vif-unplugged", "status": "completed", "tag": "4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:50:54.979865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-70c9ede9-2d97-4331-8489-739c854932b0 req-283b5be5-9acc-404c-9063-d99059237fdb service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:54.980306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-70c9ede9-2d97-4331-8489-739c854932b0 req-283b5be5-9acc-404c-9063-d99059237fdb service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:54.991856 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-70c9ede9-2d97-4331-8489-739c854932b0 req-283b5be5-9acc-404c-9063-d99059237fdb service nova] Creating event network-vif-unplugged:4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6 for instance f5b85599-217c-4d95-a8ef-136d2368cf70 on hv-cinder-83697 Jun 22 11:50:54.996861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-70c9ede9-2d97-4331-8489-739c854932b0 req-283b5be5-9acc-404c-9063-d99059237fdb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090904 Jun 22 11:50:54.997731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 312/572] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:50:55.027525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:55.028125 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:55.034539 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:55.034970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:55.035742 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:55.036162 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:55.167440 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:55.175175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:55.176688 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:55.177806 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-76e7e0a1-b8a3-4745-9d46-d4dd4e906a46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1724 microversion: 2.20 time: 0.154242 Jun 22 11:50:55.178350 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 261/573] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:55 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:55.196505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-04edc4bb-fb5f-40b4-bf29-6b7c6ba0cfad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b20ca35-9b91-472a-bf70-306f5cb998aa"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:50:55.197661 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-04edc4bb-fb5f-40b4-bf29-6b7c6ba0cfad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:55.203970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04edc4bb-fb5f-40b4-bf29-6b7c6ba0cfad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:55.204410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04edc4bb-fb5f-40b4-bf29-6b7c6ba0cfad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:55.205167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04edc4bb-fb5f-40b4-bf29-6b7c6ba0cfad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:55.205595 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04edc4bb-fb5f-40b4-bf29-6b7c6ba0cfad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:55.496359 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-04edc4bb-fb5f-40b4-bf29-6b7c6ba0cfad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304273 Jun 22 11:50:55.496966 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 313/574] 10.222.0.36 () {62 vars in 1363 bytes} [Wed Jun 22 11:50:55 2022] POST /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 11:50:55.615828 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c5ddf52d-8a1e-43ae-b1f3-2c0fc2d3fb9b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:50:55.616409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c5ddf52d-8a1e-43ae-b1f3-2c0fc2d3fb9b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:55.623208 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c5ddf52d-8a1e-43ae-b1f3-2c0fc2d3fb9b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:55.623622 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c5ddf52d-8a1e-43ae-b1f3-2c0fc2d3fb9b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:55.624382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c5ddf52d-8a1e-43ae-b1f3-2c0fc2d3fb9b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:55.624803 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c5ddf52d-8a1e-43ae-b1f3-2c0fc2d3fb9b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:55.760191 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c5ddf52d-8a1e-43ae-b1f3-2c0fc2d3fb9b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/action" status: 202 len: 0 microversion: 2.20 time: 0.148400 Jun 22 11:50:55.760800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 262/575] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Jun 22 11:50:55 2022] POST /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:50:55.769324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:55.769927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:55.777695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:55.778143 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:55.778969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:55.779463 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:55.936673 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:55.945819 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:55.947323 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:55.948500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fa93b85f-ea69-4b6c-ae71-fdbe85e3c0cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1750 microversion: 2.20 time: 0.183498 Jun 22 11:50:55.949055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 314/576] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:55 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:56.967507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:56.968117 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:56.974971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:56.975981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:56.976814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:56.977278 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:57.112971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:57.121622 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:57.123098 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:57.124445 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-86a7956f-4dc3-4485-9101-73649202e570 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1750 microversion: 2.20 time: 0.161398 Jun 22 11:50:57.125023 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 263/577] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:56 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:58.145814 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:58.146454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:58.152513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:58.152957 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:58.153712 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:58.154142 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:58.286287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:58.296110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:58.297960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:58.299122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3f595873-c6cb-432f-955c-b3c162d016fa tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1752 microversion: 2.20 time: 0.160026 Jun 22 11:50:58.299704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 315/578] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:58 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:50:59.318460 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:50:59.319628 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:50:59.326082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:59.326519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:59.327265 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:50:59.327717 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:50:59.457397 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:59.465701 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:59.467182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:50:59.468374 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-fdeee341-7c22-42d7-b3c8-5e35ba070053 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1752 microversion: 2.20 time: 0.153883 Jun 22 11:50:59.468935 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 264/579] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:50:59 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:00.485843 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:00.486421 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:00.492679 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:00.493112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:00.493866 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:00.494285 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:00.629257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:00.639157 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:00.641126 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:00.642401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-39e8fb44-7644-440e-8cfa-6f59de09a4e9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1752 microversion: 2.20 time: 0.160608 Jun 22 11:51:00.642951 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 316/580] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:00 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:01.661540 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:01.662150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:01.668656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:01.669126 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:01.669886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:01.670318 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:01.685604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:01.809980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:01.818849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:01.820966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:01.822134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b3577acd-5010-4abf-a7cf-6badf6987c46 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1752 microversion: 2.20 time: 0.164595 Jun 22 11:51:01.822698 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 265/581] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:01 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:01.966549 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c42de7e8-a6fe-4dab-b609-b9d2f807ab9a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:51:01.967668 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c42de7e8-a6fe-4dab-b609-b9d2f807ab9a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:01.973794 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c42de7e8-a6fe-4dab-b609-b9d2f807ab9a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:01.974227 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c42de7e8-a6fe-4dab-b609-b9d2f807ab9a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:01.974985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c42de7e8-a6fe-4dab-b609-b9d2f807ab9a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:01.975970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c42de7e8-a6fe-4dab-b609-b9d2f807ab9a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:01.998668 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-c42de7e8-a6fe-4dab-b609-b9d2f807ab9a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lazy-loading 'flavor' on Instance uuid 917f312d-2bff-4f24-b5ee-5009132047cd {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:51:02.094813 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:02.126213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c42de7e8-a6fe-4dab-b609-b9d2f807ab9a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/action" status: 200 len: 32 microversion: 2.1 time: 0.163622 Jun 22 11:51:02.126798 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 317/582] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:51:01 2022] POST /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 11:51:02.135687 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-52e8948f-6482-48d6-99eb-9cedef9758b7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:02.136292 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-52e8948f-6482-48d6-99eb-9cedef9758b7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:02.142569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52e8948f-6482-48d6-99eb-9cedef9758b7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:02.143025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52e8948f-6482-48d6-99eb-9cedef9758b7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:02.143881 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52e8948f-6482-48d6-99eb-9cedef9758b7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:02.144421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52e8948f-6482-48d6-99eb-9cedef9758b7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:02.284364 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-52e8948f-6482-48d6-99eb-9cedef9758b7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:02.292915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-52e8948f-6482-48d6-99eb-9cedef9758b7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.160990 Jun 22 11:51:02.293468 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 266/583] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:02 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:02.844826 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:02.845579 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:02.852058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:02.852707 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:02.854533 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:02.855125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:03.072477 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:03.081498 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:03.083041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:03.084219 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8e3e1965-225e-4229-8215-174f4e811420 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.244283 Jun 22 11:51:03.085482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 318/584] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:02 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:03.310587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-dcde98ed-27a4-4a3f-87cb-d892a33e99ed tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:03.311190 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-dcde98ed-27a4-4a3f-87cb-d892a33e99ed tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:03.318738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dcde98ed-27a4-4a3f-87cb-d892a33e99ed tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:03.320014 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dcde98ed-27a4-4a3f-87cb-d892a33e99ed tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:03.320845 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dcde98ed-27a4-4a3f-87cb-d892a33e99ed tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:03.321284 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dcde98ed-27a4-4a3f-87cb-d892a33e99ed tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:03.456176 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-dcde98ed-27a4-4a3f-87cb-d892a33e99ed tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:03.464259 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-dcde98ed-27a4-4a3f-87cb-d892a33e99ed tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.157466 Jun 22 11:51:03.464815 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 267/585] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:03 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:04.103740 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:04.104352 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:04.111775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:04.112415 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:04.113349 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:04.113893 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:04.267268 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:04.277348 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:04.278985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:04.280174 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4478e874-d1de-45d2-b171-99bb01e4ecce tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.181050 Jun 22 11:51:04.281052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 319/586] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:04 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:04.481403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b36cfcae-2d2b-4c80-84a4-f5b1831cf0d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:04.481934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b36cfcae-2d2b-4c80-84a4-f5b1831cf0d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:04.484217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=36 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:04.490014 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b36cfcae-2d2b-4c80-84a4-f5b1831cf0d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:04.490456 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b36cfcae-2d2b-4c80-84a4-f5b1831cf0d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:04.491748 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b36cfcae-2d2b-4c80-84a4-f5b1831cf0d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:04.492179 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b36cfcae-2d2b-4c80-84a4-f5b1831cf0d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:04.627072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b36cfcae-2d2b-4c80-84a4-f5b1831cf0d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:04.635921 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b36cfcae-2d2b-4c80-84a4-f5b1831cf0d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.158447 Jun 22 11:51:04.636494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 268/587] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:04 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:05.298102 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:05.298732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:05.304873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:05.305314 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:05.306070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:05.306495 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:05.437450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:05.445869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:05.447369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:05.448503 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e6b7ba4b-0ffc-41ff-9a5a-e6163286d758 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.154408 Jun 22 11:51:05.449051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 320/588] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:05 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:05.653872 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7f5f1935-2650-4f9b-bbfd-184cf9d5e7cf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:05.654466 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7f5f1935-2650-4f9b-bbfd-184cf9d5e7cf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:05.661266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f5f1935-2650-4f9b-bbfd-184cf9d5e7cf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:05.661710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f5f1935-2650-4f9b-bbfd-184cf9d5e7cf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:05.662506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f5f1935-2650-4f9b-bbfd-184cf9d5e7cf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:05.662939 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f5f1935-2650-4f9b-bbfd-184cf9d5e7cf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:05.811527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7f5f1935-2650-4f9b-bbfd-184cf9d5e7cf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:05.820534 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7f5f1935-2650-4f9b-bbfd-184cf9d5e7cf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.170480 Jun 22 11:51:05.821116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 269/589] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:05 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:06.467616 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:06.468368 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:06.474262 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:06.474703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:06.475973 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:06.476403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:06.624756 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:06.633180 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:06.634684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:06.635864 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e6c55cb8-32e7-4f3e-8b29-f1d6e1941be7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.172183 Jun 22 11:51:06.636413 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 321/590] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:06 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:06.838631 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6a257ab2-c83d-4169-884d-375a261c2b92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:06.839219 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6a257ab2-c83d-4169-884d-375a261c2b92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:06.845755 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6a257ab2-c83d-4169-884d-375a261c2b92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:06.846200 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6a257ab2-c83d-4169-884d-375a261c2b92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:06.847532 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6a257ab2-c83d-4169-884d-375a261c2b92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:06.847532 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6a257ab2-c83d-4169-884d-375a261c2b92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:06.990128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6a257ab2-c83d-4169-884d-375a261c2b92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:06.998040 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6a257ab2-c83d-4169-884d-375a261c2b92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.163906 Jun 22 11:51:06.998602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 270/591] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:06 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:07.655268 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:07.655909 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:07.657893 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=36 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:07.663477 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:07.663923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:07.664717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:07.665146 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:07.803861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:07.812265 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:07.813753 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:07.814878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9f970a07-eddf-4bbc-81f4-8f633b1ada17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.164002 Jun 22 11:51:07.815446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 322/592] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:07 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:08.015814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-52a9eb2c-a8a6-4cc7-b61d-698b9bb23f1d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:08.016362 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-52a9eb2c-a8a6-4cc7-b61d-698b9bb23f1d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:08.023117 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52a9eb2c-a8a6-4cc7-b61d-698b9bb23f1d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:08.023603 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52a9eb2c-a8a6-4cc7-b61d-698b9bb23f1d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:08.024379 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52a9eb2c-a8a6-4cc7-b61d-698b9bb23f1d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:08.024807 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-52a9eb2c-a8a6-4cc7-b61d-698b9bb23f1d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:08.160431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-52a9eb2c-a8a6-4cc7-b61d-698b9bb23f1d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:08.168955 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-52a9eb2c-a8a6-4cc7-b61d-698b9bb23f1d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.157422 Jun 22 11:51:08.169523 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 271/593] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:08 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:08.175782 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c5b1627d-ac56-46bd-94be-6a7ee64343ce tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:08.176274 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c5b1627d-ac56-46bd-94be-6a7ee64343ce tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:08.183199 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5b1627d-ac56-46bd-94be-6a7ee64343ce tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:08.183659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5b1627d-ac56-46bd-94be-6a7ee64343ce tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:08.184430 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5b1627d-ac56-46bd-94be-6a7ee64343ce tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:08.184865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5b1627d-ac56-46bd-94be-6a7ee64343ce tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:08.313784 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-c5b1627d-ac56-46bd-94be-6a7ee64343ce tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lazy-loading 'services' on Instance uuid af6ebc0a-848b-4688-939a-062ccc6dc352 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:51:08.428120 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c5b1627d-ac56-46bd-94be-6a7ee64343ce tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/os-volume_attachments/a09eb430-60ec-47e7-bceb-7f1cddc59961" status: 202 len: 0 microversion: 2.1 time: 0.366666 Jun 22 11:51:08.428710 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 323/594] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 11:51:08 2022] DELETE /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/os-volume_attachments/a09eb430-60ec-47e7-bceb-7f1cddc59961 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 11:51:08.833528 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:08.834125 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:08.840579 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:08.841012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:08.841752 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:08.842175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:08.981269 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:08.999960 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:09.002959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:09.005241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5fc65d46-9c18-4c34-babf-8fc5892959ab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.175366 Jun 22 11:51:09.006339 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 272/595] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:08 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:09.187225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ea7016f2-b816-4f88-92d4-604e7fbf7921 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:09.188164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ea7016f2-b816-4f88-92d4-604e7fbf7921 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:09.197150 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ea7016f2-b816-4f88-92d4-604e7fbf7921 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:09.197603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ea7016f2-b816-4f88-92d4-604e7fbf7921 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:09.198381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ea7016f2-b816-4f88-92d4-604e7fbf7921 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:09.198819 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ea7016f2-b816-4f88-92d4-604e7fbf7921 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:09.327629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ea7016f2-b816-4f88-92d4-604e7fbf7921 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:09.335534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ea7016f2-b816-4f88-92d4-604e7fbf7921 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.152709 Jun 22 11:51:09.336103 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 324/596] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:09 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:10.029081 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:10.029667 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:10.036330 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:10.036773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:10.038131 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:10.038560 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:10.177202 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:10.186282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:10.187940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:10.189179 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-68f88a8c-e5a3-4e28-9902-84fe1c95ae3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.164005 Jun 22 11:51:10.189818 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 273/597] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:10 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:10.352879 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6cfba108-2f22-43f7-9fbd-49d3952f4abd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:10.353446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6cfba108-2f22-43f7-9fbd-49d3952f4abd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:10.359404 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6cfba108-2f22-43f7-9fbd-49d3952f4abd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:10.359849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6cfba108-2f22-43f7-9fbd-49d3952f4abd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:10.360599 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6cfba108-2f22-43f7-9fbd-49d3952f4abd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:10.361027 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6cfba108-2f22-43f7-9fbd-49d3952f4abd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:10.503683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6cfba108-2f22-43f7-9fbd-49d3952f4abd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:10.516860 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6cfba108-2f22-43f7-9fbd-49d3952f4abd tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.167771 Jun 22 11:51:10.517421 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 325/598] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:10 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:11.208527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:11.209102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:11.216098 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:11.216538 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:11.217282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:11.217813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:11.368521 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:11.376867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:11.378342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:11.379543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-98568598-1764-432b-baa9-5a4e86be4339 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.174982 Jun 22 11:51:11.380084 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 274/599] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:11 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:11.534060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ac5ef9ba-90ab-4bf9-8933-3120c08483c6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:11.534615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ac5ef9ba-90ab-4bf9-8933-3120c08483c6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:11.540770 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ba-90ab-4bf9-8933-3120c08483c6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:11.541212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ba-90ab-4bf9-8933-3120c08483c6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:11.541972 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ba-90ab-4bf9-8933-3120c08483c6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:11.542406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ba-90ab-4bf9-8933-3120c08483c6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:11.687705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ac5ef9ba-90ab-4bf9-8933-3120c08483c6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:11.689970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ac5ef9ba-90ab-4bf9-8933-3120c08483c6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.159842 Jun 22 11:51:11.690608 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 326/600] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:11 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:12.399755 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:12.400329 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:12.406820 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:12.407180 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:12.408137 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:12.408566 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:12.562057 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:12.576562 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:12.578051 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:12.579224 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0a97f4a3-7c09-48cf-a0d1-35700f1b1bb5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.184052 Jun 22 11:51:12.580126 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 275/601] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:12 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:12.710471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-aea3a6eb-813a-4f6e-a9d1-cdf0ba7df3d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:12.711925 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-aea3a6eb-813a-4f6e-a9d1-cdf0ba7df3d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:12.719310 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aea3a6eb-813a-4f6e-a9d1-cdf0ba7df3d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:12.720656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aea3a6eb-813a-4f6e-a9d1-cdf0ba7df3d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:12.721578 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aea3a6eb-813a-4f6e-a9d1-cdf0ba7df3d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:12.722096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aea3a6eb-813a-4f6e-a9d1-cdf0ba7df3d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:12.882698 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aea3a6eb-813a-4f6e-a9d1-cdf0ba7df3d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:12.891143 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-aea3a6eb-813a-4f6e-a9d1-cdf0ba7df3d0 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.185288 Jun 22 11:51:12.891719 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 327/602] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:12 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:13.598415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:13.598994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:13.606000 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:13.606439 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:13.607367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:13.607787 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:13.739017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:13.747742 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:13.749237 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:13.750391 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-50158e52-102b-4b7a-a7d2-5a36cf0ca6b4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.155891 Jun 22 11:51:13.750940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 276/603] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:13 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:13.908216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2c13ec8b-0c6c-4abb-9493-a83e89048670 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:13.908814 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2c13ec8b-0c6c-4abb-9493-a83e89048670 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:13.914946 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c13ec8b-0c6c-4abb-9493-a83e89048670 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:13.915413 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c13ec8b-0c6c-4abb-9493-a83e89048670 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:13.916177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c13ec8b-0c6c-4abb-9493-a83e89048670 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:13.916634 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c13ec8b-0c6c-4abb-9493-a83e89048670 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:14.064012 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2c13ec8b-0c6c-4abb-9493-a83e89048670 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:14.072793 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2c13ec8b-0c6c-4abb-9493-a83e89048670 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.168289 Jun 22 11:51:14.073375 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 328/604] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:13 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:14.769481 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:14.770095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:14.776534 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:14.776966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:14.777709 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:14.778127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:14.933844 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:14.942537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:14.944698 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:14.945858 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8f9f8dc5-3b3f-4536-bc5f-f25b2eb48702 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.180387 Jun 22 11:51:14.946414 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 277/605] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:14 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:15.090649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-31030356-9bdd-4d61-9d40-a2a76d4f50ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:15.091276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-31030356-9bdd-4d61-9d40-a2a76d4f50ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:15.097223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-31030356-9bdd-4d61-9d40-a2a76d4f50ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:15.097669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-31030356-9bdd-4d61-9d40-a2a76d4f50ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:15.098424 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-31030356-9bdd-4d61-9d40-a2a76d4f50ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:15.098868 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-31030356-9bdd-4d61-9d40-a2a76d4f50ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:15.232778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-31030356-9bdd-4d61-9d40-a2a76d4f50ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:15.241265 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-31030356-9bdd-4d61-9d40-a2a76d4f50ca tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.154601 Jun 22 11:51:15.241828 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 329/606] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:15 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:15.964078 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:15.964675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:15.971235 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:15.971702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:15.972443 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:15.972869 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:16.133844 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:16.144507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:16.145927 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:16.155462 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-018ff53c-e5de-4344-bee5-d6529c882651 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.186924 Jun 22 11:51:16.156257 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 278/607] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:15 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:16.259513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-17bf413d-e91b-4fca-824c-fac169eb10d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:16.260115 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-17bf413d-e91b-4fca-824c-fac169eb10d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:16.266664 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17bf413d-e91b-4fca-824c-fac169eb10d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:16.267257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17bf413d-e91b-4fca-824c-fac169eb10d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:16.268354 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17bf413d-e91b-4fca-824c-fac169eb10d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:16.268950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17bf413d-e91b-4fca-824c-fac169eb10d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:16.417342 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-17bf413d-e91b-4fca-824c-fac169eb10d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:16.427215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-17bf413d-e91b-4fca-824c-fac169eb10d7 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.172165 Jun 22 11:51:16.428067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 330/608] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:16 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:17.174788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:17.175510 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:17.182095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:17.182536 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:17.183284 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:17.183739 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:17.323859 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:17.332652 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:17.334135 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:17.335279 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6aea5357-92ae-4165-9739-fe51382056cc tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.164469 Jun 22 11:51:17.335851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 279/609] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:17 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:17.446687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7b97ce4a-142f-415a-b41d-55936b687fe8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:17.447296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7b97ce4a-142f-415a-b41d-55936b687fe8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:17.453969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7b97ce4a-142f-415a-b41d-55936b687fe8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:17.454423 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7b97ce4a-142f-415a-b41d-55936b687fe8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:17.455191 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7b97ce4a-142f-415a-b41d-55936b687fe8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:17.455659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7b97ce4a-142f-415a-b41d-55936b687fe8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:17.585807 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7b97ce4a-142f-415a-b41d-55936b687fe8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:17.593681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7b97ce4a-142f-415a-b41d-55936b687fe8 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.151541 Jun 22 11:51:17.594243 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 331/610] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:17 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:18.354386 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:18.354930 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:18.361453 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:18.361887 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:18.362638 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:18.363065 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:18.497748 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:18.506135 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:18.508139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:18.509438 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-43e4cecd-cc90-48e9-aa32-39c074cc13f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.159533 Jun 22 11:51:18.510046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 280/611] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:18 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:18.611308 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a09df0c0-3e99-416c-9f97-f7e5642b28d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:18.611881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a09df0c0-3e99-416c-9f97-f7e5642b28d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:18.618531 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a09df0c0-3e99-416c-9f97-f7e5642b28d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:18.618974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a09df0c0-3e99-416c-9f97-f7e5642b28d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:18.619760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a09df0c0-3e99-416c-9f97-f7e5642b28d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:18.620200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a09df0c0-3e99-416c-9f97-f7e5642b28d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:18.748299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a09df0c0-3e99-416c-9f97-f7e5642b28d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:18.750590 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:18.757703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a09df0c0-3e99-416c-9f97-f7e5642b28d3 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.150343 Jun 22 11:51:18.758256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 332/612] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:18 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:19.528177 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:19.528782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:19.535275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:19.535750 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:19.536530 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:19.536958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:19.666489 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:19.674789 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:19.676317 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:19.677458 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e8b7c55a-3bbd-4ce6-8b30-6bdb97e25395 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.153204 Jun 22 11:51:19.678016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 281/613] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:19 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:19.775539 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3af8ba5b-170f-4a67-bef8-855a34264202 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:19.776145 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3af8ba5b-170f-4a67-bef8-855a34264202 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:19.783137 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3af8ba5b-170f-4a67-bef8-855a34264202 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:19.783561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3af8ba5b-170f-4a67-bef8-855a34264202 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:19.784324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3af8ba5b-170f-4a67-bef8-855a34264202 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:19.784761 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3af8ba5b-170f-4a67-bef8-855a34264202 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:19.915997 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3af8ba5b-170f-4a67-bef8-855a34264202 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:19.923903 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3af8ba5b-170f-4a67-bef8-855a34264202 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.152544 Jun 22 11:51:19.924462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 333/614] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:19 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:20.696717 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:20.697319 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:20.703928 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:20.704370 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:20.705116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:20.705544 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:20.708058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:20.834328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:20.843300 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:20.844814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:20.845953 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f3cd972c-461f-439a-9779-7af552ab70a5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.153646 Jun 22 11:51:20.846508 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 282/615] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:20 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:20.941746 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f7a8ed9c-53b1-476e-b7ee-41c48abcb583 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:20.942352 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f7a8ed9c-53b1-476e-b7ee-41c48abcb583 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:20.949717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f7a8ed9c-53b1-476e-b7ee-41c48abcb583 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:20.950098 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f7a8ed9c-53b1-476e-b7ee-41c48abcb583 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:20.950880 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f7a8ed9c-53b1-476e-b7ee-41c48abcb583 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:20.951308 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f7a8ed9c-53b1-476e-b7ee-41c48abcb583 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:21.093829 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f7a8ed9c-53b1-476e-b7ee-41c48abcb583 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:21.103007 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f7a8ed9c-53b1-476e-b7ee-41c48abcb583 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.165015 Jun 22 11:51:21.103623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 334/616] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:20 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:21.864495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:21.865070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:21.871648 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:21.872091 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:21.872850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:21.873273 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:22.002302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:22.010953 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:22.012492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:22.013684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b2a69a71-ec58-4004-a654-c157db8032fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.153066 Jun 22 11:51:22.014783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 283/617] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:21 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:22.121849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ebe4b55a-2369-478e-b05f-befe500ed1e6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:22.122479 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ebe4b55a-2369-478e-b05f-befe500ed1e6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:22.137655 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ebe4b55a-2369-478e-b05f-befe500ed1e6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:22.142152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ebe4b55a-2369-478e-b05f-befe500ed1e6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:22.143096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ebe4b55a-2369-478e-b05f-befe500ed1e6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:22.143588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ebe4b55a-2369-478e-b05f-befe500ed1e6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:22.275162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ebe4b55a-2369-478e-b05f-befe500ed1e6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:22.283167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ebe4b55a-2369-478e-b05f-befe500ed1e6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.165549 Jun 22 11:51:22.283764 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 335/618] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:22 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:23.032643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:23.033244 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:23.040192 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:23.040634 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:23.041388 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:23.041817 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:23.175850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:23.184669 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:23.186187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:23.187328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6d0a2a3e-8c6c-4a50-8bc0-a7535c4a7da5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.158643 Jun 22 11:51:23.187899 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 284/619] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:23 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:23.300576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b2c6b6da-e199-4448-b4fe-8747899c3894 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:23.301259 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b2c6b6da-e199-4448-b4fe-8747899c3894 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:23.307738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b2c6b6da-e199-4448-b4fe-8747899c3894 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:23.308192 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b2c6b6da-e199-4448-b4fe-8747899c3894 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:23.308969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b2c6b6da-e199-4448-b4fe-8747899c3894 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:23.309572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b2c6b6da-e199-4448-b4fe-8747899c3894 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:23.441251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b2c6b6da-e199-4448-b4fe-8747899c3894 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:23.449176 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b2c6b6da-e199-4448-b4fe-8747899c3894 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.152513 Jun 22 11:51:23.449735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 336/620] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:23 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:24.205910 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:24.206518 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:24.213066 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:24.213504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:24.214260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:24.214686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:24.379585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-56bc4067-8ca4-494f-bc2b-acd54f56b65b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:51:24.383614 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:24.385699 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-56bc4067-8ca4-494f-bc2b-acd54f56b65b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:24.386140 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-56bc4067-8ca4-494f-bc2b-acd54f56b65b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:24.392181 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:24.393700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:24.395273 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-06c50fef-4f33-4ea6-87e9-f94b941d227b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.192903 Jun 22 11:51:24.395741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 285/621] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:24 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:24.446466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-56bc4067-8ca4-494f-bc2b-acd54f56b65b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Going to try to stop instance {{(pid=129528) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 11:51:24.466062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c9102f42-e094-4a00-ab78-888185235712 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:24.466593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c9102f42-e094-4a00-ab78-888185235712 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:24.473605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9102f42-e094-4a00-ab78-888185235712 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:24.474064 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9102f42-e094-4a00-ab78-888185235712 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:24.475528 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9102f42-e094-4a00-ab78-888185235712 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:24.475978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9102f42-e094-4a00-ab78-888185235712 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:24.490459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-56bc4067-8ca4-494f-bc2b-acd54f56b65b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/action" status: 202 len: 0 microversion: 2.1 time: 0.114556 Jun 22 11:51:24.491754 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 337/622] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:51:24 2022] POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 11:51:24.500096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2d4795c3-14aa-4b7b-8622-fc5c73a8b016 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:24.500947 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2d4795c3-14aa-4b7b-8622-fc5c73a8b016 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:24.507181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d4795c3-14aa-4b7b-8622-fc5c73a8b016 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:24.507669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d4795c3-14aa-4b7b-8622-fc5c73a8b016 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:24.508441 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d4795c3-14aa-4b7b-8622-fc5c73a8b016 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:24.508874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d4795c3-14aa-4b7b-8622-fc5c73a8b016 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:24.670595 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c9102f42-e094-4a00-ab78-888185235712 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:24.679403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c9102f42-e094-4a00-ab78-888185235712 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.217308 Jun 22 11:51:24.679968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 286/623] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:24 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:24.684680 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2d4795c3-14aa-4b7b-8622-fc5c73a8b016 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:24.692648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2d4795c3-14aa-4b7b-8622-fc5c73a8b016 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.196567 Jun 22 11:51:24.693198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 338/624] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:24 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:25.413492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:25.414092 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:25.420571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:25.421022 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:25.421768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:25.422208 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:25.551963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:25.560811 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:25.562299 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:25.563471 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a4da2170-2576-40e7-b590-a88f285ca917 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.153941 Jun 22 11:51:25.564026 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 287/625] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:25 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:25.696324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9ed43498-a2e2-438c-ae4a-aa6b56f43d9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:25.696876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9ed43498-a2e2-438c-ae4a-aa6b56f43d9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:25.702840 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9ed43498-a2e2-438c-ae4a-aa6b56f43d9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:25.703284 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9ed43498-a2e2-438c-ae4a-aa6b56f43d9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:25.704071 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9ed43498-a2e2-438c-ae4a-aa6b56f43d9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:25.704504 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9ed43498-a2e2-438c-ae4a-aa6b56f43d9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:25.709723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-cfcb7f04-beee-4b22-944f-37af7d50261d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:25.710365 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-cfcb7f04-beee-4b22-944f-37af7d50261d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:25.716289 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-cfcb7f04-beee-4b22-944f-37af7d50261d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:25.716736 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-cfcb7f04-beee-4b22-944f-37af7d50261d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:25.717498 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-cfcb7f04-beee-4b22-944f-37af7d50261d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:25.717936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-cfcb7f04-beee-4b22-944f-37af7d50261d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:25.904264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9ed43498-a2e2-438c-ae4a-aa6b56f43d9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:25.911286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-cfcb7f04-beee-4b22-944f-37af7d50261d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:25.912636 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9ed43498-a2e2-438c-ae4a-aa6b56f43d9d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.220656 Jun 22 11:51:25.913303 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 339/626] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:25 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:25.919914 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-cfcb7f04-beee-4b22-944f-37af7d50261d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1725 microversion: 2.1 time: 0.213953 Jun 22 11:51:25.920465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 288/627] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:25 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:26.582013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:26.582613 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:26.589417 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:26.589866 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:26.590621 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:26.591051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:26.718873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:26.727194 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:26.728795 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:26.729929 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a1f7a99d-a9af-4f0b-baf3-0575e7cea12d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.151859 Jun 22 11:51:26.730477 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 340/628] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:26 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:26.931097 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-eb43051c-cfcb-4712-9951-8af9f524f08f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:26.931772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-eb43051c-cfcb-4712-9951-8af9f524f08f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:26.937246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c627e00f-afa3-48ed-bff4-86951367ffe2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:26.937879 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c627e00f-afa3-48ed-bff4-86951367ffe2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:26.938508 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-eb43051c-cfcb-4712-9951-8af9f524f08f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:26.938960 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-eb43051c-cfcb-4712-9951-8af9f524f08f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:26.939753 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-eb43051c-cfcb-4712-9951-8af9f524f08f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:26.940185 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-eb43051c-cfcb-4712-9951-8af9f524f08f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:26.944007 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c627e00f-afa3-48ed-bff4-86951367ffe2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:26.945145 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c627e00f-afa3-48ed-bff4-86951367ffe2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:26.946017 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c627e00f-afa3-48ed-bff4-86951367ffe2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:26.946965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c627e00f-afa3-48ed-bff4-86951367ffe2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:27.129932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-eb43051c-cfcb-4712-9951-8af9f524f08f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:27.134510 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c627e00f-afa3-48ed-bff4-86951367ffe2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:27.138813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-eb43051c-cfcb-4712-9951-8af9f524f08f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.212204 Jun 22 11:51:27.139664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 289/629] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:26 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:27.142354 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c627e00f-afa3-48ed-bff4-86951367ffe2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.208842 Jun 22 11:51:27.142907 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 341/630] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:26 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:27.748796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:27.749393 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:27.755575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:27.756018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:27.756806 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:27.757231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:27.888897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:27.897643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:27.899664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:27.900800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-fc10d263-a154-4085-9646-b236d4010a72 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.155886 Jun 22 11:51:27.901339 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 290/631] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:27 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:28.156230 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7785d062-f464-4735-afe9-5c8a8678919a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:28.156833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7785d062-f464-4735-afe9-5c8a8678919a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:28.160113 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-73a83aaf-401c-4949-b33c-17ea31320664 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:28.160712 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-73a83aaf-401c-4949-b33c-17ea31320664 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:28.162856 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7785d062-f464-4735-afe9-5c8a8678919a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:28.163301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7785d062-f464-4735-afe9-5c8a8678919a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:28.164095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7785d062-f464-4735-afe9-5c8a8678919a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:28.164526 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7785d062-f464-4735-afe9-5c8a8678919a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:28.167003 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73a83aaf-401c-4949-b33c-17ea31320664 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:28.167464 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73a83aaf-401c-4949-b33c-17ea31320664 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:28.168224 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73a83aaf-401c-4949-b33c-17ea31320664 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:28.168650 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73a83aaf-401c-4949-b33c-17ea31320664 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:28.604851 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7785d062-f464-4735-afe9-5c8a8678919a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:28.607625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-73a83aaf-401c-4949-b33c-17ea31320664 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:28.612994 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7785d062-f464-4735-afe9-5c8a8678919a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1734 microversion: 2.1 time: 0.460555 Jun 22 11:51:28.613729 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 342/632] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:28 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1734 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:28.615168 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-73a83aaf-401c-4949-b33c-17ea31320664 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.458699 Jun 22 11:51:28.615746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 291/633] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:28 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:28.924908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:28.925512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:28.932013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:28.932459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:28.933249 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:28.933677 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:29.063097 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:29.072588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:29.074082 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:29.075218 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-64a34539-726d-489b-b46e-60c09cc253e5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.154208 Jun 22 11:51:29.075801 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 343/634] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:28 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:29.630261 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d9595c66-9d9b-485a-8f40-cef680660468 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:29.630874 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d9595c66-9d9b-485a-8f40-cef680660468 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:29.631718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-509ec2c9-f52c-4415-a0eb-dd68a0baee38 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:29.632321 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-509ec2c9-f52c-4415-a0eb-dd68a0baee38 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:29.637396 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9595c66-9d9b-485a-8f40-cef680660468 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:29.637849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9595c66-9d9b-485a-8f40-cef680660468 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:29.638589 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9595c66-9d9b-485a-8f40-cef680660468 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:29.638723 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-509ec2c9-f52c-4415-a0eb-dd68a0baee38 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:29.639019 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9595c66-9d9b-485a-8f40-cef680660468 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:29.639125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-509ec2c9-f52c-4415-a0eb-dd68a0baee38 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:29.640062 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-509ec2c9-f52c-4415-a0eb-dd68a0baee38 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:29.640496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-509ec2c9-f52c-4415-a0eb-dd68a0baee38 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:29.833404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d9595c66-9d9b-485a-8f40-cef680660468 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:29.836413 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-509ec2c9-f52c-4415-a0eb-dd68a0baee38 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:29.841409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d9595c66-9d9b-485a-8f40-cef680660468 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1714 microversion: 2.1 time: 0.214968 Jun 22 11:51:29.841980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 292/635] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:29 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1714 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:29.843714 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-509ec2c9-f52c-4415-a0eb-dd68a0baee38 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.215621 Jun 22 11:51:29.844262 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 344/636] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:29 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:29.896489 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:29.896979 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:29.902915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:29.903370 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:29.904126 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:29.904552 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.027534 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] HTTP exception thrown: Cannot 'detach_volume' instance 917f312d-2bff-4f24-b5ee-5009132047cd while it is in vm_state rescued Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Request method failure captured: Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments/81de4c09-8497-4418-9d87-8dcad11969c4 HTTP/1.1 Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswDQxWzIxo8L5QrqUkiWxFb74S_4r3NBQOJ4hKUuQsgRXMFyN-xWyQGiIP0dyUdqvS5aykt2GDDGJWzhMBWy1CiaPbE9Ss9zKyf_rUf2kDN7EST2rbUklHXeBv05p1XtQ6cRoUK9eZw2b2e4Lejk_iT-ELbafxVWciapxpL1eJB2NUo Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:51:30.029143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20536d2fa444e97b7184c10e52d5cc5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 27cc3d38926f470c91eeb6aecfc86a48 Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:51:30.030722 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Cannot 'detach_volume' instance 917f312d-2bff-4f24-b5ee-5009132047cd while it is in vm_state rescued Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'server_id': '917f312d-2bff-4f24-b5ee-5009132047cd', 'id': '81de4c09-8497-4418-9d87-8dcad11969c4'} Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 917f312d-2bff-4f24-b5ee-5009132047cd in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:51:30.031472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 917f312d-2bff-4f24-b5ee-5009132047cd while it is in vm_state rescued Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 917f312d-2bff-4f24-b5ee-5009132047cd while it is in vm_state rescued Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:51:30.032751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Returning 409 to user: Cannot 'detach_volume' instance 917f312d-2bff-4f24-b5ee-5009132047cd while it is in vm_state rescued {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:51:30.033749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d3ef8038-6df7-4f8d-95a6-61402aa05fef tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "DELETE /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments/81de4c09-8497-4418-9d87-8dcad11969c4" status: 409 len: 152 microversion: 2.1 time: 0.137970 Jun 22 11:51:30.033749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 293/637] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 11:51:29 2022] DELETE /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments/81de4c09-8497-4418-9d87-8dcad11969c4 => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 11:51:30.039570 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f2a7ea40-f41c-4dfa-9745-abcb80f2954d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:51:30.040597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f2a7ea40-f41c-4dfa-9745-abcb80f2954d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:30.046493 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f2a7ea40-f41c-4dfa-9745-abcb80f2954d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.046939 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f2a7ea40-f41c-4dfa-9745-abcb80f2954d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.047721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f2a7ea40-f41c-4dfa-9745-abcb80f2954d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.048148 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f2a7ea40-f41c-4dfa-9745-abcb80f2954d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.093333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:30.093938 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:30.100809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.101257 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.102040 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.102444 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.111530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f2a7ea40-f41c-4dfa-9745-abcb80f2954d tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "POST /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/action" status: 202 len: 0 microversion: 2.1 time: 0.075784 Jun 22 11:51:30.112186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 345/638] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:51:30 2022] POST /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:51:30.121462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bce0e79c-4c4e-4884-adbb-788fe7394bfc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:30.122164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bce0e79c-4c4e-4884-adbb-788fe7394bfc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:30.128187 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bce0e79c-4c4e-4884-adbb-788fe7394bfc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.128741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bce0e79c-4c4e-4884-adbb-788fe7394bfc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.129492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bce0e79c-4c4e-4884-adbb-788fe7394bfc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.129914 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bce0e79c-4c4e-4884-adbb-788fe7394bfc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.301046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:30.305956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bce0e79c-4c4e-4884-adbb-788fe7394bfc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:30.311333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:30.312847 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:30.314002 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4a399883-3bd3-4e28-adfc-5d498d6dc601 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.224532 Jun 22 11:51:30.314712 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bce0e79c-4c4e-4884-adbb-788fe7394bfc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1722 microversion: 2.1 time: 0.197712 Jun 22 11:51:30.314861 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 294/639] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:30 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:51:30.315277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 346/640] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:30 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:30.788421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-69960435-a0de-448a-903e-fb188f917926 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:51:30.789473 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-69960435-a0de-448a-903e-fb188f917926 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:30.796586 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-69960435-a0de-448a-903e-fb188f917926 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.797026 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-69960435-a0de-448a-903e-fb188f917926 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.797776 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-69960435-a0de-448a-903e-fb188f917926 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.798204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-69960435-a0de-448a-903e-fb188f917926 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.862235 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-474b4ff7-db0b-4fe0-ba4b-d21132093d4b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:30.862848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-474b4ff7-db0b-4fe0-ba4b-d21132093d4b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:30.869532 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-474b4ff7-db0b-4fe0-ba4b-d21132093d4b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.869981 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-474b4ff7-db0b-4fe0-ba4b-d21132093d4b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.870751 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-474b4ff7-db0b-4fe0-ba4b-d21132093d4b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.871186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-474b4ff7-db0b-4fe0-ba4b-d21132093d4b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.872944 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-69960435-a0de-448a-903e-fb188f917926 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "POST /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/action" status: 202 len: 0 microversion: 2.1 time: 0.088225 Jun 22 11:51:30.876762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 295/641] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:51:30 2022] POST /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:51:30.881981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e262ef98-92f6-4b93-8359-8fadf34ba7c8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:30.882668 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e262ef98-92f6-4b93-8359-8fadf34ba7c8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:30.886272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:30.889571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e262ef98-92f6-4b93-8359-8fadf34ba7c8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.890344 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e262ef98-92f6-4b93-8359-8fadf34ba7c8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:30.891445 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e262ef98-92f6-4b93-8359-8fadf34ba7c8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:30.891637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e262ef98-92f6-4b93-8359-8fadf34ba7c8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:31.059800 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-474b4ff7-db0b-4fe0-ba4b-d21132093d4b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:31.069495 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-474b4ff7-db0b-4fe0-ba4b-d21132093d4b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.211051 Jun 22 11:51:31.070204 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 347/642] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:30 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:31.098841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e262ef98-92f6-4b93-8359-8fadf34ba7c8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:31.107610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e262ef98-92f6-4b93-8359-8fadf34ba7c8 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1753 microversion: 2.1 time: 0.229617 Jun 22 11:51:31.108160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 296/643] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:30 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:31.331497 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5035e298-e84b-42fa-b7ce-f65f5eb4bc3b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:31.332009 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:31.332126 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5035e298-e84b-42fa-b7ce-f65f5eb4bc3b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:31.332612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:31.338129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5035e298-e84b-42fa-b7ce-f65f5eb4bc3b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:31.338440 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:31.338575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5035e298-e84b-42fa-b7ce-f65f5eb4bc3b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:31.338898 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:31.339335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5035e298-e84b-42fa-b7ce-f65f5eb4bc3b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:31.339665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:31.339775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5035e298-e84b-42fa-b7ce-f65f5eb4bc3b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:31.340094 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:31.535595 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:31.538364 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:31.544174 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5035e298-e84b-42fa-b7ce-f65f5eb4bc3b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:31.547069 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:31.548603 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:31.549741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5d45db69-ad15-46f1-96e8-dba7e556b277 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.221403 Jun 22 11:51:31.550421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 297/644] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:31 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:51:31.552586 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5035e298-e84b-42fa-b7ce-f65f5eb4bc3b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1722 microversion: 2.1 time: 0.224964 Jun 22 11:51:31.553145 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 348/645] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:31 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:32.088167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-589e5626-c39d-40c5-be5f-bbd1b531f1e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:32.088736 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-589e5626-c39d-40c5-be5f-bbd1b531f1e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:32.102517 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589e5626-c39d-40c5-be5f-bbd1b531f1e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:32.103387 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589e5626-c39d-40c5-be5f-bbd1b531f1e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:32.103930 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589e5626-c39d-40c5-be5f-bbd1b531f1e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:32.104963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589e5626-c39d-40c5-be5f-bbd1b531f1e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:32.126784 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a66a8761-3809-4d11-950f-2c63f34e2167 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:32.127318 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a66a8761-3809-4d11-950f-2c63f34e2167 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:32.134290 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a66a8761-3809-4d11-950f-2c63f34e2167 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:32.134799 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a66a8761-3809-4d11-950f-2c63f34e2167 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:32.135969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a66a8761-3809-4d11-950f-2c63f34e2167 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:32.136754 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a66a8761-3809-4d11-950f-2c63f34e2167 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:32.389277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-589e5626-c39d-40c5-be5f-bbd1b531f1e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:32.397838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-589e5626-c39d-40c5-be5f-bbd1b531f1e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.314265 Jun 22 11:51:32.398507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 298/646] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:32 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:32.420852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a66a8761-3809-4d11-950f-2c63f34e2167 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:32.429344 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a66a8761-3809-4d11-950f-2c63f34e2167 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1753 microversion: 2.1 time: 0.306338 Jun 22 11:51:32.429914 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 349/647] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:32 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1753 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:32.569049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:32.569606 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1d8cec5e-76a6-4772-9187-62cf558e0403 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:32.569760 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:32.570212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1d8cec5e-76a6-4772-9187-62cf558e0403 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:32.576379 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1d8cec5e-76a6-4772-9187-62cf558e0403 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:32.576568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:32.576819 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1d8cec5e-76a6-4772-9187-62cf558e0403 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:32.576977 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:32.577735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:32.578072 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1d8cec5e-76a6-4772-9187-62cf558e0403 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:32.578204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:32.578516 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1d8cec5e-76a6-4772-9187-62cf558e0403 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:32.796297 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1d8cec5e-76a6-4772-9187-62cf558e0403 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:32.801502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:32.806320 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1d8cec5e-76a6-4772-9187-62cf558e0403 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1722 microversion: 2.1 time: 0.239772 Jun 22 11:51:32.807632 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 350/648] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:32 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:32.812965 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:32.814812 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:32.816416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-838e3118-2f1d-499c-8f4d-3c8c3aaafb35 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.251308 Jun 22 11:51:32.817470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 299/649] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:32 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:33.416069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f9bb4a83-23a2-4529-8df4-51ae24d9c77c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:33.416664 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f9bb4a83-23a2-4529-8df4-51ae24d9c77c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:33.422764 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f9bb4a83-23a2-4529-8df4-51ae24d9c77c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:33.423208 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f9bb4a83-23a2-4529-8df4-51ae24d9c77c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:33.424041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f9bb4a83-23a2-4529-8df4-51ae24d9c77c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:33.424472 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f9bb4a83-23a2-4529-8df4-51ae24d9c77c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:33.447525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9272583c-e4c6-4c2b-b8ea-0baab2f5fa21 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:33.448138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9272583c-e4c6-4c2b-b8ea-0baab2f5fa21 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:33.454493 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9272583c-e4c6-4c2b-b8ea-0baab2f5fa21 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:33.454939 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9272583c-e4c6-4c2b-b8ea-0baab2f5fa21 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:33.455728 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9272583c-e4c6-4c2b-b8ea-0baab2f5fa21 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:33.456154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9272583c-e4c6-4c2b-b8ea-0baab2f5fa21 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:33.620216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f9bb4a83-23a2-4529-8df4-51ae24d9c77c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:33.627704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f9bb4a83-23a2-4529-8df4-51ae24d9c77c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.215410 Jun 22 11:51:33.628274 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 351/650] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:33 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:33.650232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9272583c-e4c6-4c2b-b8ea-0baab2f5fa21 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:33.661835 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9272583c-e4c6-4c2b-b8ea-0baab2f5fa21 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.218419 Jun 22 11:51:33.662693 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 300/651] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:33 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:33.825003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c8b28a35-7ee8-4fbb-aaf6-7899ed4b6adf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:33.825605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c8b28a35-7ee8-4fbb-aaf6-7899ed4b6adf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:33.833440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c8b28a35-7ee8-4fbb-aaf6-7899ed4b6adf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:33.833884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c8b28a35-7ee8-4fbb-aaf6-7899ed4b6adf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:33.834644 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c8b28a35-7ee8-4fbb-aaf6-7899ed4b6adf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:33.835064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c8b28a35-7ee8-4fbb-aaf6-7899ed4b6adf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:33.835787 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:33.836596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:33.842708 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:33.843282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:33.844083 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:33.844508 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:34.054561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c8b28a35-7ee8-4fbb-aaf6-7899ed4b6adf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:34.060625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:34.063543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c8b28a35-7ee8-4fbb-aaf6-7899ed4b6adf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1722 microversion: 2.1 time: 0.243124 Jun 22 11:51:34.064122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 352/652] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:33 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:34.074363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:34.076730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:34.078525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-aa9d21c1-eb37-4e4e-81c3-bf5755a0bd06 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.246610 Jun 22 11:51:34.079434 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 301/653] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:33 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:51:34.645884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9f5dba1e-3db9-4e4d-b082-28a7b1ab244c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:34.646491 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9f5dba1e-3db9-4e4d-b082-28a7b1ab244c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:34.653543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f5dba1e-3db9-4e4d-b082-28a7b1ab244c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:34.653985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f5dba1e-3db9-4e4d-b082-28a7b1ab244c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:34.654750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f5dba1e-3db9-4e4d-b082-28a7b1ab244c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:34.655180 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f5dba1e-3db9-4e4d-b082-28a7b1ab244c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:34.685728 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1e2cc1e9-5262-4cef-9990-588bcae81d01 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:34.686451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1e2cc1e9-5262-4cef-9990-588bcae81d01 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:34.688823 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=68 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:34.694272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e2cc1e9-5262-4cef-9990-588bcae81d01 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:34.694720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e2cc1e9-5262-4cef-9990-588bcae81d01 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:34.695521 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e2cc1e9-5262-4cef-9990-588bcae81d01 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:34.695976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1e2cc1e9-5262-4cef-9990-588bcae81d01 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:34.844678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9f5dba1e-3db9-4e4d-b082-28a7b1ab244c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:34.853053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9f5dba1e-3db9-4e4d-b082-28a7b1ab244c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.210990 Jun 22 11:51:34.853624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 353/654] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:34 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:34.884454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1e2cc1e9-5262-4cef-9990-588bcae81d01 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:34.892743 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1e2cc1e9-5262-4cef-9990-588bcae81d01 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.211193 Jun 22 11:51:34.893314 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 302/655] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:34 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:35.080885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2873b7fe-821a-4b83-bd03-b9b57672a580 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:35.081484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2873b7fe-821a-4b83-bd03-b9b57672a580 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:35.087956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2873b7fe-821a-4b83-bd03-b9b57672a580 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.088489 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2873b7fe-821a-4b83-bd03-b9b57672a580 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:35.089245 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2873b7fe-821a-4b83-bd03-b9b57672a580 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.089670 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2873b7fe-821a-4b83-bd03-b9b57672a580 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:35.097254 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:35.097861 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:35.103959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.104409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:35.105213 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.105645 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:35.302549 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2873b7fe-821a-4b83-bd03-b9b57672a580 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:35.314431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:35.320692 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2873b7fe-821a-4b83-bd03-b9b57672a580 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1722 microversion: 2.1 time: 0.243427 Jun 22 11:51:35.329473 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:35.331588 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:35.333260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-41f37828-7e33-4528-b98c-73494916cc19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.239720 Jun 22 11:51:35.334044 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 303/657] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:35 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:51:35.334180 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 354/657] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:35 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:35.431522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-6ac286c8-6a26-40ba-a5dd-995b602caa47 req-0f9e46aa-1c6a-4147-96ba-30513b379951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b85599-217c-4d95-a8ef-136d2368cf70", "name": "network-vif-plugged", "status": "completed", "tag": "4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:51:35.439918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-6ac286c8-6a26-40ba-a5dd-995b602caa47 req-0f9e46aa-1c6a-4147-96ba-30513b379951 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.440365 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-6ac286c8-6a26-40ba-a5dd-995b602caa47 req-0f9e46aa-1c6a-4147-96ba-30513b379951 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:35.451763 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-6ac286c8-6a26-40ba-a5dd-995b602caa47 req-0f9e46aa-1c6a-4147-96ba-30513b379951 service nova] Creating event network-vif-plugged:4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6 for instance f5b85599-217c-4d95-a8ef-136d2368cf70 on hv-cinder-83697 Jun 22 11:51:35.456444 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-6ac286c8-6a26-40ba-a5dd-995b602caa47 req-0f9e46aa-1c6a-4147-96ba-30513b379951 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028569 Jun 22 11:51:35.457025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 304/658] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:51:35.875642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3ffcd416-fac3-4581-a853-794fe9af13a6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:35.876376 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3ffcd416-fac3-4581-a853-794fe9af13a6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:35.885387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ffcd416-fac3-4581-a853-794fe9af13a6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.885835 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ffcd416-fac3-4581-a853-794fe9af13a6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:35.886608 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ffcd416-fac3-4581-a853-794fe9af13a6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.887040 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ffcd416-fac3-4581-a853-794fe9af13a6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:35.911565 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-44ffbbf4-0fef-4518-927f-c2f878206297 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:35.912266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-44ffbbf4-0fef-4518-927f-c2f878206297 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:35.919298 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-44ffbbf4-0fef-4518-927f-c2f878206297 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.919772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-44ffbbf4-0fef-4518-927f-c2f878206297 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:35.920543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-44ffbbf4-0fef-4518-927f-c2f878206297 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:35.921008 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-44ffbbf4-0fef-4518-927f-c2f878206297 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:36.074209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3ffcd416-fac3-4581-a853-794fe9af13a6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:36.081717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3ffcd416-fac3-4581-a853-794fe9af13a6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.212526 Jun 22 11:51:36.082287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 355/659] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:35 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:36.113782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-44ffbbf4-0fef-4518-927f-c2f878206297 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:36.122231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-44ffbbf4-0fef-4518-927f-c2f878206297 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.215843 Jun 22 11:51:36.122791 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 305/660] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:35 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:36.338944 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e15a9be9-663c-49ab-bcf9-8a36f1a652ec tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:36.339590 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e15a9be9-663c-49ab-bcf9-8a36f1a652ec tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:36.347015 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e15a9be9-663c-49ab-bcf9-8a36f1a652ec tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:36.347488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e15a9be9-663c-49ab-bcf9-8a36f1a652ec tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:36.348256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e15a9be9-663c-49ab-bcf9-8a36f1a652ec tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:36.348685 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e15a9be9-663c-49ab-bcf9-8a36f1a652ec tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:36.358063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:36.358669 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:36.365504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:36.366082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:36.366980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:36.367581 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:36.552861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e15a9be9-663c-49ab-bcf9-8a36f1a652ec tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:36.560837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e15a9be9-663c-49ab-bcf9-8a36f1a652ec tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1722 microversion: 2.1 time: 0.226280 Jun 22 11:51:36.561418 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 356/661] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:36 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:36.566739 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:36.576032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:36.577554 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:36.578697 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2f1ecd34-4bbb-45a8-b815-805f6c2f11ec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.226022 Jun 22 11:51:36.579242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 306/662] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:36 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:37.099122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-02f1fa8c-9ab5-4862-b298-cf473f902341 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:37.099883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-02f1fa8c-9ab5-4862-b298-cf473f902341 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:37.106118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-02f1fa8c-9ab5-4862-b298-cf473f902341 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.106567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-02f1fa8c-9ab5-4862-b298-cf473f902341 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.107335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-02f1fa8c-9ab5-4862-b298-cf473f902341 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.107795 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-02f1fa8c-9ab5-4862-b298-cf473f902341 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.140812 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a2967bc6-700e-4749-a5c9-3c4843ef5733 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:37.141515 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a2967bc6-700e-4749-a5c9-3c4843ef5733 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:37.148261 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a2967bc6-700e-4749-a5c9-3c4843ef5733 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.149432 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a2967bc6-700e-4749-a5c9-3c4843ef5733 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.150130 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a2967bc6-700e-4749-a5c9-3c4843ef5733 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.150689 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a2967bc6-700e-4749-a5c9-3c4843ef5733 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.291985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-02f1fa8c-9ab5-4862-b298-cf473f902341 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:37.299603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-02f1fa8c-9ab5-4862-b298-cf473f902341 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.204295 Jun 22 11:51:37.300179 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 357/663] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:37 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:37.333946 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a2967bc6-700e-4749-a5c9-3c4843ef5733 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:37.342553 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a2967bc6-700e-4749-a5c9-3c4843ef5733 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.206062 Jun 22 11:51:37.343114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 307/664] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:37 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:37.578112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-17fcb423-a8f4-4bd8-a785-25295e1f8bfb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:37.578622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-17fcb423-a8f4-4bd8-a785-25295e1f8bfb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:37.584612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17fcb423-a8f4-4bd8-a785-25295e1f8bfb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.585053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17fcb423-a8f4-4bd8-a785-25295e1f8bfb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.585806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17fcb423-a8f4-4bd8-a785-25295e1f8bfb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.586236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-17fcb423-a8f4-4bd8-a785-25295e1f8bfb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.597711 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:37.598416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:37.604406 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.604844 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.605599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.606024 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.784513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-17fcb423-a8f4-4bd8-a785-25295e1f8bfb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:37.792483 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:37.793044 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-17fcb423-a8f4-4bd8-a785-25295e1f8bfb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1728 microversion: 2.1 time: 0.218778 Jun 22 11:51:37.793625 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 358/665] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:37 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:37.801915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:37.803416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:37.804570 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2fdab7a1-62e4-4b8c-a1ba-baa50b5e62d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.210737 Jun 22 11:51:37.805116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 308/666] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:37 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:51:37.810814 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-eabc3e52-204e-4f08-a27f-ef93743ec6a6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:37.811296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-eabc3e52-204e-4f08-a27f-ef93743ec6a6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:37.813190 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=74 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:37.818732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eabc3e52-204e-4f08-a27f-ef93743ec6a6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.819171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eabc3e52-204e-4f08-a27f-ef93743ec6a6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.819959 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eabc3e52-204e-4f08-a27f-ef93743ec6a6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:37.820384 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eabc3e52-204e-4f08-a27f-ef93743ec6a6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:37.898545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-eabc3e52-204e-4f08-a27f-ef93743ec6a6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090656 Jun 22 11:51:37.900338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 359/667] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 11:51:37 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:51:38.317029 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ca81796e-f6b0-4f07-bab8-5f4bdf9bb0e3 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:38.317561 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ca81796e-f6b0-4f07-bab8-5f4bdf9bb0e3 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:38.325488 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca81796e-f6b0-4f07-bab8-5f4bdf9bb0e3 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:38.325934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca81796e-f6b0-4f07-bab8-5f4bdf9bb0e3 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:38.326733 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca81796e-f6b0-4f07-bab8-5f4bdf9bb0e3 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:38.327189 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca81796e-f6b0-4f07-bab8-5f4bdf9bb0e3 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:38.359658 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d7ee6c39-b6b9-4fcb-a0e6-bde14b772c12 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:38.360400 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d7ee6c39-b6b9-4fcb-a0e6-bde14b772c12 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:38.366629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d7ee6c39-b6b9-4fcb-a0e6-bde14b772c12 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:38.367162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d7ee6c39-b6b9-4fcb-a0e6-bde14b772c12 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:38.368586 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d7ee6c39-b6b9-4fcb-a0e6-bde14b772c12 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:38.369083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d7ee6c39-b6b9-4fcb-a0e6-bde14b772c12 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:38.640435 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ca81796e-f6b0-4f07-bab8-5f4bdf9bb0e3 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:38.648020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ca81796e-f6b0-4f07-bab8-5f4bdf9bb0e3 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.334946 Jun 22 11:51:38.648593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 309/668] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:38 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:38.681015 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d7ee6c39-b6b9-4fcb-a0e6-bde14b772c12 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:38.689426 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d7ee6c39-b6b9-4fcb-a0e6-bde14b772c12 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.333490 Jun 22 11:51:38.689999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 360/669] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:38 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:38.828494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:38.829476 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:38.839756 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:38.840387 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:38.841320 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:38.841907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:39.339767 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:39.348865 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:39.350592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:39.352036 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-288315dc-0458-42cb-9f13-4606367e24e3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1808 microversion: 2.20 time: 0.529679 Jun 22 11:51:39.353084 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 310/670] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:38 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1808 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:39.383644 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-e9392c68-1b8d-410c-b080-d4419fec0af6 req-dc023718-e16d-41bb-a4a6-817ea1da13d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917f312d-2bff-4f24-b5ee-5009132047cd", "tag": "18b5b430-c735-4878-a26d-6c754a8d3c06"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:51:39.401193 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-e9392c68-1b8d-410c-b080-d4419fec0af6 req-dc023718-e16d-41bb-a4a6-817ea1da13d3 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:39.402130 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-e9392c68-1b8d-410c-b080-d4419fec0af6 req-dc023718-e16d-41bb-a4a6-817ea1da13d3 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:39.414320 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-e9392c68-1b8d-410c-b080-d4419fec0af6 req-dc023718-e16d-41bb-a4a6-817ea1da13d3 service nova] Creating event network-changed:18b5b430-c735-4878-a26d-6c754a8d3c06 for instance 917f312d-2bff-4f24-b5ee-5009132047cd on hv-cinder-83697 Jun 22 11:51:39.419645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-e9392c68-1b8d-410c-b080-d4419fec0af6 req-dc023718-e16d-41bb-a4a6-817ea1da13d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132456 Jun 22 11:51:39.420239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 361/671] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:51:39.668811 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8e36dc97-1d06-4a03-a9e9-da5aa7327a89 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:39.669412 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8e36dc97-1d06-4a03-a9e9-da5aa7327a89 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:39.675717 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e36dc97-1d06-4a03-a9e9-da5aa7327a89 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:39.676385 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e36dc97-1d06-4a03-a9e9-da5aa7327a89 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:39.677277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e36dc97-1d06-4a03-a9e9-da5aa7327a89 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:39.677564 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e36dc97-1d06-4a03-a9e9-da5aa7327a89 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:39.708796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c462e04c-9f56-4896-b00a-5c4de04afcfb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:39.709505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c462e04c-9f56-4896-b00a-5c4de04afcfb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:39.716487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c462e04c-9f56-4896-b00a-5c4de04afcfb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:39.716940 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c462e04c-9f56-4896-b00a-5c4de04afcfb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:39.717904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c462e04c-9f56-4896-b00a-5c4de04afcfb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:39.718496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c462e04c-9f56-4896-b00a-5c4de04afcfb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:40.013118 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8e36dc97-1d06-4a03-a9e9-da5aa7327a89 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:40.022198 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8e36dc97-1d06-4a03-a9e9-da5aa7327a89 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.357128 Jun 22 11:51:40.032397 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 311/672] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:39 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:40.032608 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c462e04c-9f56-4896-b00a-5c4de04afcfb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:40.034398 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c462e04c-9f56-4896-b00a-5c4de04afcfb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.331188 Jun 22 11:51:40.035170 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 362/673] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:39 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:40.370558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:40.371154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:40.377745 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:40.378183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:40.378930 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:40.379376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:40.513836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:40.526363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:40.528590 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:40.530282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-13a46899-1578-457b-8f20-8021f5134e6b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1795 microversion: 2.20 time: 0.163976 Jun 22 11:51:40.531103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 312/674] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:51:40 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1795 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:51:41.040652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-57400992-8e00-4b7f-93b9-0c95c0e7a22c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:41.041468 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-57400992-8e00-4b7f-93b9-0c95c0e7a22c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:41.047532 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-57400992-8e00-4b7f-93b9-0c95c0e7a22c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:41.047988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-57400992-8e00-4b7f-93b9-0c95c0e7a22c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:41.048749 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-57400992-8e00-4b7f-93b9-0c95c0e7a22c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:41.049186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-57400992-8e00-4b7f-93b9-0c95c0e7a22c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:41.052277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f2f087c4-21e8-472b-a94a-2785b1fd16d4 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:41.052892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f2f087c4-21e8-472b-a94a-2785b1fd16d4 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:41.059633 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f2f087c4-21e8-472b-a94a-2785b1fd16d4 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:41.060090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f2f087c4-21e8-472b-a94a-2785b1fd16d4 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:41.060863 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f2f087c4-21e8-472b-a94a-2785b1fd16d4 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:41.061297 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f2f087c4-21e8-472b-a94a-2785b1fd16d4 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:41.249911 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-57400992-8e00-4b7f-93b9-0c95c0e7a22c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:41.257357 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-57400992-8e00-4b7f-93b9-0c95c0e7a22c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1679 microversion: 2.1 time: 0.221226 Jun 22 11:51:41.258289 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 363/675] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:41 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:41.274460 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f2f087c4-21e8-472b-a94a-2785b1fd16d4 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:41.283168 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f2f087c4-21e8-472b-a94a-2785b1fd16d4 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.234653 Jun 22 11:51:41.283770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 313/676] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:41 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:41.433695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-48e3096b-dfbb-4921-9972-51198bb3ff02 req-3b2fe235-3b3d-40a1-8d26-5ef31fdc6c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917f312d-2bff-4f24-b5ee-5009132047cd", "tag": "18b5b430-c735-4878-a26d-6c754a8d3c06"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:51:41.441787 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-48e3096b-dfbb-4921-9972-51198bb3ff02 req-3b2fe235-3b3d-40a1-8d26-5ef31fdc6c6c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:41.442216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-48e3096b-dfbb-4921-9972-51198bb3ff02 req-3b2fe235-3b3d-40a1-8d26-5ef31fdc6c6c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:41.453067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-48e3096b-dfbb-4921-9972-51198bb3ff02 req-3b2fe235-3b3d-40a1-8d26-5ef31fdc6c6c service nova] Creating event network-changed:18b5b430-c735-4878-a26d-6c754a8d3c06 for instance 917f312d-2bff-4f24-b5ee-5009132047cd on hv-cinder-83697 Jun 22 11:51:41.457781 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-48e3096b-dfbb-4921-9972-51198bb3ff02 req-3b2fe235-3b3d-40a1-8d26-5ef31fdc6c6c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027689 Jun 22 11:51:41.458335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 364/677] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:51:42.277913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9bf98c28-2eb8-4bba-a93c-8133fc5b8546 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:42.278449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9bf98c28-2eb8-4bba-a93c-8133fc5b8546 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:42.284871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9bf98c28-2eb8-4bba-a93c-8133fc5b8546 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:42.285308 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9bf98c28-2eb8-4bba-a93c-8133fc5b8546 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:42.286057 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9bf98c28-2eb8-4bba-a93c-8133fc5b8546 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:42.286478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9bf98c28-2eb8-4bba-a93c-8133fc5b8546 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:42.300894 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2431991c-1bd0-4851-9191-ec292626e02b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:42.301595 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2431991c-1bd0-4851-9191-ec292626e02b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:42.308419 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2431991c-1bd0-4851-9191-ec292626e02b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:42.308915 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2431991c-1bd0-4851-9191-ec292626e02b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:42.309683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2431991c-1bd0-4851-9191-ec292626e02b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:42.310111 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2431991c-1bd0-4851-9191-ec292626e02b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:42.480162 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9bf98c28-2eb8-4bba-a93c-8133fc5b8546 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:42.487662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9bf98c28-2eb8-4bba-a93c-8133fc5b8546 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1656 microversion: 2.1 time: 0.213636 Jun 22 11:51:42.488235 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 314/678] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:42 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1656 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:42.505243 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-df56ce3b-db27-421d-af60-ce352a5fc2ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:51:42.509199 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2431991c-1bd0-4851-9191-ec292626e02b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:42.511842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:42.512191 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df56ce3b-db27-421d-af60-ce352a5fc2ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:42.512677 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df56ce3b-db27-421d-af60-ce352a5fc2ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:42.517547 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:51:42.519657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2431991c-1bd0-4851-9191-ec292626e02b tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.222616 Jun 22 11:51:42.520255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 365/679] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:42 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:42.544676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-df56ce3b-db27-421d-af60-ce352a5fc2ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Going to try to start instance {{(pid=129527) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 11:51:42.586339 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-df56ce3b-db27-421d-af60-ce352a5fc2ff tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/action" status: 202 len: 0 microversion: 2.1 time: 0.084640 Jun 22 11:51:42.586928 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 315/680] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:51:42 2022] POST /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 11:51:42.595107 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-606483eb-7cc1-4d43-946e-87a7019d1c99 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:42.595827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-606483eb-7cc1-4d43-946e-87a7019d1c99 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:42.603209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-606483eb-7cc1-4d43-946e-87a7019d1c99 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:42.603806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-606483eb-7cc1-4d43-946e-87a7019d1c99 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:42.604568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-606483eb-7cc1-4d43-946e-87a7019d1c99 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:42.605021 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-606483eb-7cc1-4d43-946e-87a7019d1c99 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:42.761838 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-606483eb-7cc1-4d43-946e-87a7019d1c99 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:42.769686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-606483eb-7cc1-4d43-946e-87a7019d1c99 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1665 microversion: 2.1 time: 0.178375 Jun 22 11:51:42.770259 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 366/681] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:42 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:43.538092 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d828d459-0056-46b0-94d0-089aad1f7fe6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:43.538784 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d828d459-0056-46b0-94d0-089aad1f7fe6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:43.546129 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d828d459-0056-46b0-94d0-089aad1f7fe6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:43.546575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d828d459-0056-46b0-94d0-089aad1f7fe6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:43.547342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d828d459-0056-46b0-94d0-089aad1f7fe6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:43.547794 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d828d459-0056-46b0-94d0-089aad1f7fe6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:43.690322 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d828d459-0056-46b0-94d0-089aad1f7fe6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:43.698267 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d828d459-0056-46b0-94d0-089aad1f7fe6 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.164389 Jun 22 11:51:43.698830 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 316/682] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:43 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:43.788331 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-676c3ae5-d92e-4ddb-a36d-35b9c03079a8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:43.790139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-676c3ae5-d92e-4ddb-a36d-35b9c03079a8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:43.796698 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676c3ae5-d92e-4ddb-a36d-35b9c03079a8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:43.797172 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676c3ae5-d92e-4ddb-a36d-35b9c03079a8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:43.797839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676c3ae5-d92e-4ddb-a36d-35b9c03079a8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:43.798395 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676c3ae5-d92e-4ddb-a36d-35b9c03079a8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:43.942998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-676c3ae5-d92e-4ddb-a36d-35b9c03079a8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:43.951683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-676c3ae5-d92e-4ddb-a36d-35b9c03079a8 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1665 microversion: 2.1 time: 0.167758 Jun 22 11:51:43.952275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 367/683] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:43 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:44.716075 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2855a96e-322e-4824-9fdb-0f8fff21bf6a tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:44.716684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2855a96e-322e-4824-9fdb-0f8fff21bf6a tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:44.723099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2855a96e-322e-4824-9fdb-0f8fff21bf6a tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:44.723574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2855a96e-322e-4824-9fdb-0f8fff21bf6a tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:44.724326 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2855a96e-322e-4824-9fdb-0f8fff21bf6a tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:44.724751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2855a96e-322e-4824-9fdb-0f8fff21bf6a tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:44.864933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2855a96e-322e-4824-9fdb-0f8fff21bf6a tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:44.873496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2855a96e-322e-4824-9fdb-0f8fff21bf6a tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.161216 Jun 22 11:51:44.874062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 317/684] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:44 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:44.969798 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fb82331f-242b-4e1b-9402-889b7331d8c1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:44.970327 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fb82331f-242b-4e1b-9402-889b7331d8c1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:44.976734 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fb82331f-242b-4e1b-9402-889b7331d8c1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:44.977181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fb82331f-242b-4e1b-9402-889b7331d8c1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:44.977926 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fb82331f-242b-4e1b-9402-889b7331d8c1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:44.978355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fb82331f-242b-4e1b-9402-889b7331d8c1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:45.111051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fb82331f-242b-4e1b-9402-889b7331d8c1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:45.119134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fb82331f-242b-4e1b-9402-889b7331d8c1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1669 microversion: 2.1 time: 0.153257 Jun 22 11:51:45.119727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 368/685] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:44 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:45.891669 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8887650c-8e07-45ca-8176-58a4cfd6aae2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:45.892303 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8887650c-8e07-45ca-8176-58a4cfd6aae2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:45.898709 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8887650c-8e07-45ca-8176-58a4cfd6aae2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:45.899142 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8887650c-8e07-45ca-8176-58a4cfd6aae2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:45.899921 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8887650c-8e07-45ca-8176-58a4cfd6aae2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:45.900344 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8887650c-8e07-45ca-8176-58a4cfd6aae2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:46.043343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8887650c-8e07-45ca-8176-58a4cfd6aae2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:46.051399 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8887650c-8e07-45ca-8176-58a4cfd6aae2 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.163850 Jun 22 11:51:46.051947 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 318/686] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:45 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:51:47.068553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7ec6f2f2-bbe1-4ffc-991b-1435fbb11d13 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:47.069157 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7ec6f2f2-bbe1-4ffc-991b-1435fbb11d13 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:47.075786 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7ec6f2f2-bbe1-4ffc-991b-1435fbb11d13 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:47.076235 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7ec6f2f2-bbe1-4ffc-991b-1435fbb11d13 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:47.076988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7ec6f2f2-bbe1-4ffc-991b-1435fbb11d13 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:47.077419 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7ec6f2f2-bbe1-4ffc-991b-1435fbb11d13 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:47.226323 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7ec6f2f2-bbe1-4ffc-991b-1435fbb11d13 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:47.234457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7ec6f2f2-bbe1-4ffc-991b-1435fbb11d13 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.169628 Jun 22 11:51:47.234878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 369/687] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:47 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:48.252223 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a3bc4153-7fb6-49bb-9951-56dca4a6f651 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:48.252804 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a3bc4153-7fb6-49bb-9951-56dca4a6f651 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:48.259838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a3bc4153-7fb6-49bb-9951-56dca4a6f651 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:48.260292 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a3bc4153-7fb6-49bb-9951-56dca4a6f651 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:48.261040 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a3bc4153-7fb6-49bb-9951-56dca4a6f651 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:48.261468 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a3bc4153-7fb6-49bb-9951-56dca4a6f651 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:48.407852 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a3bc4153-7fb6-49bb-9951-56dca4a6f651 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:48.416083 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a3bc4153-7fb6-49bb-9951-56dca4a6f651 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1758 microversion: 2.1 time: 0.167765 Jun 22 11:51:48.416653 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 319/688] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:48 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:51:49.432325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6747d3dc-8642-4615-910c-b09d8e5edba1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:51:49.432994 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6747d3dc-8642-4615-910c-b09d8e5edba1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:51:49.439485 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6747d3dc-8642-4615-910c-b09d8e5edba1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:49.439933 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6747d3dc-8642-4615-910c-b09d8e5edba1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:49.440708 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6747d3dc-8642-4615-910c-b09d8e5edba1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:51:49.441141 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6747d3dc-8642-4615-910c-b09d8e5edba1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:51:49.589164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6747d3dc-8642-4615-910c-b09d8e5edba1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:51:49.597134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6747d3dc-8642-4615-910c-b09d8e5edba1 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1761 microversion: 2.1 time: 0.168638 Jun 22 11:51:49.597693 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 370/689] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:51:49 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:21.879856 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bb592256-efd0-486f-84e8-865dc0021f82 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:52:21.880575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bb592256-efd0-486f-84e8-865dc0021f82 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:21.883050 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=35 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:52:21.883718 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:52:21.890640 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bb592256-efd0-486f-84e8-865dc0021f82 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:21.891216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bb592256-efd0-486f-84e8-865dc0021f82 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:21.892012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bb592256-efd0-486f-84e8-865dc0021f82 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:21.892436 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bb592256-efd0-486f-84e8-865dc0021f82 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:21.919726 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-bb592256-efd0-486f-84e8-865dc0021f82 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lazy-loading 'flavor' on Instance uuid a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:52:21.995093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bb592256-efd0-486f-84e8-865dc0021f82 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "POST /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61/action" status: 202 len: 0 microversion: 2.1 time: 0.118773 Jun 22 11:52:21.995704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 320/690] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:52:21 2022] POST /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:52:22.004267 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6916fe66-e69f-4740-82be-ab905945f23c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:22.004906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6916fe66-e69f-4740-82be-ab905945f23c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:22.007063 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=23 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:52:22.007805 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=31 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:52:22.014454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6916fe66-e69f-4740-82be-ab905945f23c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:22.014908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6916fe66-e69f-4740-82be-ab905945f23c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:22.015746 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6916fe66-e69f-4740-82be-ab905945f23c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:22.016182 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6916fe66-e69f-4740-82be-ab905945f23c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:22.151313 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6916fe66-e69f-4740-82be-ab905945f23c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:22.159065 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6916fe66-e69f-4740-82be-ab905945f23c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.158892 Jun 22 11:52:22.159682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 371/691] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:21 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:23.180470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-44d9a1ec-0067-4390-b3a7-6645ae826d76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:23.181127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-44d9a1ec-0067-4390-b3a7-6645ae826d76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:23.187807 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-44d9a1ec-0067-4390-b3a7-6645ae826d76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:23.188246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-44d9a1ec-0067-4390-b3a7-6645ae826d76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:23.188996 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-44d9a1ec-0067-4390-b3a7-6645ae826d76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:23.189425 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-44d9a1ec-0067-4390-b3a7-6645ae826d76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:23.321111 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-44d9a1ec-0067-4390-b3a7-6645ae826d76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:23.330641 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-44d9a1ec-0067-4390-b3a7-6645ae826d76 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.155239 Jun 22 11:52:23.331219 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 321/692] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:23 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:24.348812 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9a495d75-1adf-4190-b414-acb99a8ab9ba tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:24.349344 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9a495d75-1adf-4190-b414-acb99a8ab9ba tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:24.355311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a495d75-1adf-4190-b414-acb99a8ab9ba tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:24.355778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a495d75-1adf-4190-b414-acb99a8ab9ba tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:24.356526 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a495d75-1adf-4190-b414-acb99a8ab9ba tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:24.356948 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a495d75-1adf-4190-b414-acb99a8ab9ba tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:24.490447 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9a495d75-1adf-4190-b414-acb99a8ab9ba tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:24.498023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9a495d75-1adf-4190-b414-acb99a8ab9ba tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.153146 Jun 22 11:52:24.498579 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 372/693] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:24 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:25.514688 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8235803f-a87b-4f1a-9323-5b4e869f6dc3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:25.515225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8235803f-a87b-4f1a-9323-5b4e869f6dc3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:25.521822 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8235803f-a87b-4f1a-9323-5b4e869f6dc3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:25.522265 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8235803f-a87b-4f1a-9323-5b4e869f6dc3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:25.523021 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8235803f-a87b-4f1a-9323-5b4e869f6dc3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:25.523483 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8235803f-a87b-4f1a-9323-5b4e869f6dc3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:25.657273 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8235803f-a87b-4f1a-9323-5b4e869f6dc3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:25.665922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8235803f-a87b-4f1a-9323-5b4e869f6dc3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.155538 Jun 22 11:52:25.666479 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 322/694] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:25 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:26.684562 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b4a974ce-0065-46da-9b00-1f6c9a68bd6e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:26.685164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b4a974ce-0065-46da-9b00-1f6c9a68bd6e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:26.691094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4a974ce-0065-46da-9b00-1f6c9a68bd6e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:26.691943 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4a974ce-0065-46da-9b00-1f6c9a68bd6e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:26.692324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4a974ce-0065-46da-9b00-1f6c9a68bd6e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:26.692751 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4a974ce-0065-46da-9b00-1f6c9a68bd6e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:26.826007 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b4a974ce-0065-46da-9b00-1f6c9a68bd6e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:26.834434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b4a974ce-0065-46da-9b00-1f6c9a68bd6e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.154248 Jun 22 11:52:26.835012 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 373/695] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:26 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:27.851610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-453af7a7-5c14-4c5e-b3fd-4f42e8a06225 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:27.852211 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-453af7a7-5c14-4c5e-b3fd-4f42e8a06225 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:27.859304 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-453af7a7-5c14-4c5e-b3fd-4f42e8a06225 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:27.859771 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-453af7a7-5c14-4c5e-b3fd-4f42e8a06225 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:27.860525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-453af7a7-5c14-4c5e-b3fd-4f42e8a06225 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:27.860954 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-453af7a7-5c14-4c5e-b3fd-4f42e8a06225 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:27.995434 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-453af7a7-5c14-4c5e-b3fd-4f42e8a06225 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:28.002874 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-453af7a7-5c14-4c5e-b3fd-4f42e8a06225 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.155146 Jun 22 11:52:28.003488 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 323/696] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:27 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:29.021341 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2d8524f7-b1fa-4207-ba38-a83ac3633f91 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:29.022007 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2d8524f7-b1fa-4207-ba38-a83ac3633f91 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:29.028454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d8524f7-b1fa-4207-ba38-a83ac3633f91 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:29.028904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d8524f7-b1fa-4207-ba38-a83ac3633f91 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:29.029717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d8524f7-b1fa-4207-ba38-a83ac3633f91 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:29.030198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d8524f7-b1fa-4207-ba38-a83ac3633f91 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:29.161634 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2d8524f7-b1fa-4207-ba38-a83ac3633f91 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:29.170138 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2d8524f7-b1fa-4207-ba38-a83ac3633f91 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.153074 Jun 22 11:52:29.170694 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 374/697] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:29 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:30.187528 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4041bb41-9e31-4cb5-9f08-4ece0b200c79 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:30.188147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4041bb41-9e31-4cb5-9f08-4ece0b200c79 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:30.194650 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4041bb41-9e31-4cb5-9f08-4ece0b200c79 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:30.195056 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4041bb41-9e31-4cb5-9f08-4ece0b200c79 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:30.195843 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4041bb41-9e31-4cb5-9f08-4ece0b200c79 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:30.196269 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4041bb41-9e31-4cb5-9f08-4ece0b200c79 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:30.333529 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4041bb41-9e31-4cb5-9f08-4ece0b200c79 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:30.341103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4041bb41-9e31-4cb5-9f08-4ece0b200c79 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.157424 Jun 22 11:52:30.341667 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 324/698] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:30 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:52:31.358939 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-816daecb-b55a-43cc-972b-6771e8e42acc tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:31.359568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-816daecb-b55a-43cc-972b-6771e8e42acc tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:31.365639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-816daecb-b55a-43cc-972b-6771e8e42acc tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:31.366081 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-816daecb-b55a-43cc-972b-6771e8e42acc tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:31.366854 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-816daecb-b55a-43cc-972b-6771e8e42acc tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:31.367276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-816daecb-b55a-43cc-972b-6771e8e42acc tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:31.500202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-816daecb-b55a-43cc-972b-6771e8e42acc tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:31.507827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-816daecb-b55a-43cc-972b-6771e8e42acc tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.153277 Jun 22 11:52:31.508387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 375/699] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:31 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:32.525280 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4a0f9213-5e7c-4071-b965-b94758f76603 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:32.525875 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4a0f9213-5e7c-4071-b965-b94758f76603 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:32.533442 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4a0f9213-5e7c-4071-b965-b94758f76603 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:32.533883 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4a0f9213-5e7c-4071-b965-b94758f76603 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:32.534777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4a0f9213-5e7c-4071-b965-b94758f76603 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:32.535222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4a0f9213-5e7c-4071-b965-b94758f76603 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:32.686479 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4a0f9213-5e7c-4071-b965-b94758f76603 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:32.694119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4a0f9213-5e7c-4071-b965-b94758f76603 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.172713 Jun 22 11:52:32.694679 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 325/700] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:32 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:33.711555 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e3c52dfe-28de-4bc1-806d-8be0100d141d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:33.712143 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e3c52dfe-28de-4bc1-806d-8be0100d141d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:33.718610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e3c52dfe-28de-4bc1-806d-8be0100d141d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:33.719045 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e3c52dfe-28de-4bc1-806d-8be0100d141d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:33.719853 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e3c52dfe-28de-4bc1-806d-8be0100d141d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:33.720280 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e3c52dfe-28de-4bc1-806d-8be0100d141d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:33.852969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e3c52dfe-28de-4bc1-806d-8be0100d141d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:33.861180 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e3c52dfe-28de-4bc1-806d-8be0100d141d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.153494 Jun 22 11:52:33.861759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 376/701] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:33 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:34.878298 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7b124df9-e144-4319-a287-9fb238122a14 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:34.878902 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7b124df9-e144-4319-a287-9fb238122a14 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:34.886074 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7b124df9-e144-4319-a287-9fb238122a14 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:34.886517 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7b124df9-e144-4319-a287-9fb238122a14 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:34.887271 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7b124df9-e144-4319-a287-9fb238122a14 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:34.887731 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7b124df9-e144-4319-a287-9fb238122a14 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:35.021081 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7b124df9-e144-4319-a287-9fb238122a14 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:35.028592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7b124df9-e144-4319-a287-9fb238122a14 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.154242 Jun 22 11:52:35.029161 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 326/702] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:34 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:36.046585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-30cf9833-d370-4fc8-b80c-82a40d32353b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:36.047293 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-30cf9833-d370-4fc8-b80c-82a40d32353b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:36.053248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-30cf9833-d370-4fc8-b80c-82a40d32353b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:36.053681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-30cf9833-d370-4fc8-b80c-82a40d32353b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:36.054436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-30cf9833-d370-4fc8-b80c-82a40d32353b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:36.054858 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-30cf9833-d370-4fc8-b80c-82a40d32353b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:36.189331 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-30cf9833-d370-4fc8-b80c-82a40d32353b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:36.197642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-30cf9833-d370-4fc8-b80c-82a40d32353b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.155482 Jun 22 11:52:36.198716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 377/703] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:36 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:37.216345 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-792a0a3e-c8b6-4440-897d-93a978a20d51 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:37.216877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-792a0a3e-c8b6-4440-897d-93a978a20d51 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:37.223282 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-792a0a3e-c8b6-4440-897d-93a978a20d51 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:37.223754 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-792a0a3e-c8b6-4440-897d-93a978a20d51 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:37.224496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-792a0a3e-c8b6-4440-897d-93a978a20d51 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:37.224918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-792a0a3e-c8b6-4440-897d-93a978a20d51 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:37.353598 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-792a0a3e-c8b6-4440-897d-93a978a20d51 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:37.361263 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-792a0a3e-c8b6-4440-897d-93a978a20d51 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.148787 Jun 22 11:52:37.361844 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 327/704] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:37 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:52:38.378884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0d4fddac-37a3-4746-a776-bfb071c54fa6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:38.379524 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0d4fddac-37a3-4746-a776-bfb071c54fa6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:38.385616 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d4fddac-37a3-4746-a776-bfb071c54fa6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:38.386355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d4fddac-37a3-4746-a776-bfb071c54fa6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:38.386824 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d4fddac-37a3-4746-a776-bfb071c54fa6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:38.387252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d4fddac-37a3-4746-a776-bfb071c54fa6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:38.523141 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0d4fddac-37a3-4746-a776-bfb071c54fa6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:38.530888 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0d4fddac-37a3-4746-a776-bfb071c54fa6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.155819 Jun 22 11:52:38.531476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 378/705] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:38 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:39.547756 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f19658b3-46f3-49e7-b4b7-677ef6f7560e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:39.548361 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f19658b3-46f3-49e7-b4b7-677ef6f7560e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:39.554691 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f19658b3-46f3-49e7-b4b7-677ef6f7560e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:39.555129 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f19658b3-46f3-49e7-b4b7-677ef6f7560e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:39.555926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f19658b3-46f3-49e7-b4b7-677ef6f7560e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:39.556350 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f19658b3-46f3-49e7-b4b7-677ef6f7560e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:39.691207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f19658b3-46f3-49e7-b4b7-677ef6f7560e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:39.699409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f19658b3-46f3-49e7-b4b7-677ef6f7560e tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.154896 Jun 22 11:52:39.699982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 328/706] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:39 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:40.717480 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8329ec33-bbe0-4383-9aac-1b816b97afc1 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:40.718091 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8329ec33-bbe0-4383-9aac-1b816b97afc1 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:40.724122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8329ec33-bbe0-4383-9aac-1b816b97afc1 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:40.724703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8329ec33-bbe0-4383-9aac-1b816b97afc1 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:40.725338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8329ec33-bbe0-4383-9aac-1b816b97afc1 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:40.725846 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8329ec33-bbe0-4383-9aac-1b816b97afc1 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:40.858696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8329ec33-bbe0-4383-9aac-1b816b97afc1 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:40.866211 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8329ec33-bbe0-4383-9aac-1b816b97afc1 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1509 microversion: 2.1 time: 0.153073 Jun 22 11:52:40.866762 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 379/707] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:40 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:40.882440 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3fca45a4-1b20-47ec-ad83-ae24eb1fe9fd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:52:40.883024 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3fca45a4-1b20-47ec-ad83-ae24eb1fe9fd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:40.890171 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3fca45a4-1b20-47ec-ad83-ae24eb1fe9fd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:40.890610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3fca45a4-1b20-47ec-ad83-ae24eb1fe9fd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:40.891395 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3fca45a4-1b20-47ec-ad83-ae24eb1fe9fd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:40.891799 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3fca45a4-1b20-47ec-ad83-ae24eb1fe9fd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:40.967183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3fca45a4-1b20-47ec-ad83-ae24eb1fe9fd tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "POST /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61/action" status: 202 len: 0 microversion: 2.1 time: 0.088478 Jun 22 11:52:40.967788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 329/708] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:52:40 2022] POST /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 11:52:40.975721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-400b6d1f-c299-49b3-b25c-4c974bd7313a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:40.976447 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-400b6d1f-c299-49b3-b25c-4c974bd7313a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:40.982455 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-400b6d1f-c299-49b3-b25c-4c974bd7313a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:40.982966 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-400b6d1f-c299-49b3-b25c-4c974bd7313a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:40.983763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-400b6d1f-c299-49b3-b25c-4c974bd7313a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:40.984180 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-400b6d1f-c299-49b3-b25c-4c974bd7313a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:41.123526 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-400b6d1f-c299-49b3-b25c-4c974bd7313a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:41.131120 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-400b6d1f-c299-49b3-b25c-4c974bd7313a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1517 microversion: 2.1 time: 0.159164 Jun 22 11:52:41.131791 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 380/709] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:40 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:41.607252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-0691ef51-2a69-4989-bc79-de65bc91198e req-6c861415-0650-468b-979d-def1d0b19102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3eb4a54-d3df-4eca-b1ef-3dcb13716d61", "name": "network-vif-unplugged", "status": "completed", "tag": "372fe7e2-a11e-410a-ad0b-3ed41c865845"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:52:41.615759 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-0691ef51-2a69-4989-bc79-de65bc91198e req-6c861415-0650-468b-979d-def1d0b19102 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:41.616186 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-0691ef51-2a69-4989-bc79-de65bc91198e req-6c861415-0650-468b-979d-def1d0b19102 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:41.629538 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.compute.server_external_events [req-0691ef51-2a69-4989-bc79-de65bc91198e req-6c861415-0650-468b-979d-def1d0b19102 service nova] Unable to find a host for instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61. Dropping event network-vif-unplugged {{(pid=129527) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 11:52:41.630407 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-0691ef51-2a69-4989-bc79-de65bc91198e req-6c861415-0650-468b-979d-def1d0b19102 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027574 Jun 22 11:52:41.631006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 330/710] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 11:52:42.149557 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-721c7aa7-f366-4b97-a7f2-5bd6df1755b0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:42.150346 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-721c7aa7-f366-4b97-a7f2-5bd6df1755b0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:42.157716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-721c7aa7-f366-4b97-a7f2-5bd6df1755b0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:42.158292 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-721c7aa7-f366-4b97-a7f2-5bd6df1755b0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:42.159257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-721c7aa7-f366-4b97-a7f2-5bd6df1755b0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:42.159714 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-721c7aa7-f366-4b97-a7f2-5bd6df1755b0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:42.290041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-721c7aa7-f366-4b97-a7f2-5bd6df1755b0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:42.298066 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-721c7aa7-f366-4b97-a7f2-5bd6df1755b0 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1519 microversion: 2.1 time: 0.152398 Jun 22 11:52:42.298625 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 381/711] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:42 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:43.315882 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e2b4c6d4-48bb-4e45-8109-731c3fa40fef tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:43.316575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e2b4c6d4-48bb-4e45-8109-731c3fa40fef tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:43.323222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2b4c6d4-48bb-4e45-8109-731c3fa40fef tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:43.323716 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2b4c6d4-48bb-4e45-8109-731c3fa40fef tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:43.324463 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2b4c6d4-48bb-4e45-8109-731c3fa40fef tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:43.324888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2b4c6d4-48bb-4e45-8109-731c3fa40fef tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:43.798500 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e2b4c6d4-48bb-4e45-8109-731c3fa40fef tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:43.805877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e2b4c6d4-48bb-4e45-8109-731c3fa40fef tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.493814 Jun 22 11:52:43.806443 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 331/712] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:43 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:44.920929 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bf8bd9e8-93c1-4dbd-af37-938f5be22125 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:44.921538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bf8bd9e8-93c1-4dbd-af37-938f5be22125 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:44.927545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bf8bd9e8-93c1-4dbd-af37-938f5be22125 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:44.927982 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bf8bd9e8-93c1-4dbd-af37-938f5be22125 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:44.928724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bf8bd9e8-93c1-4dbd-af37-938f5be22125 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:44.929146 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bf8bd9e8-93c1-4dbd-af37-938f5be22125 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:45.061597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bf8bd9e8-93c1-4dbd-af37-938f5be22125 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:45.069154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bf8bd9e8-93c1-4dbd-af37-938f5be22125 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.250081 Jun 22 11:52:45.069711 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 382/713] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:44 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:46.086059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c4344b25-7a72-46fc-a215-4df4719b14ce tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:46.086667 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c4344b25-7a72-46fc-a215-4df4719b14ce tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:46.093139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c4344b25-7a72-46fc-a215-4df4719b14ce tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:46.093580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c4344b25-7a72-46fc-a215-4df4719b14ce tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:46.094350 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c4344b25-7a72-46fc-a215-4df4719b14ce tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:46.094751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c4344b25-7a72-46fc-a215-4df4719b14ce tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:46.224936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c4344b25-7a72-46fc-a215-4df4719b14ce tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:46.232873 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c4344b25-7a72-46fc-a215-4df4719b14ce tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.150624 Jun 22 11:52:46.233430 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 332/714] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:46 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:47.249913 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1f3f1670-3dec-4a5a-ad00-dbeb0d7b2f6d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:47.250457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1f3f1670-3dec-4a5a-ad00-dbeb0d7b2f6d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:47.256412 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f3f1670-3dec-4a5a-ad00-dbeb0d7b2f6d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:47.256850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f3f1670-3dec-4a5a-ad00-dbeb0d7b2f6d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:47.257610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f3f1670-3dec-4a5a-ad00-dbeb0d7b2f6d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:47.258032 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f3f1670-3dec-4a5a-ad00-dbeb0d7b2f6d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:47.389676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1f3f1670-3dec-4a5a-ad00-dbeb0d7b2f6d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:47.397243 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1f3f1670-3dec-4a5a-ad00-dbeb0d7b2f6d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.151798 Jun 22 11:52:47.397809 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 383/715] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:47 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:48.414103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-da62fde9-7861-4780-9008-cbbec61ffce8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:48.414711 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-da62fde9-7861-4780-9008-cbbec61ffce8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:48.421234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da62fde9-7861-4780-9008-cbbec61ffce8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:48.421674 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da62fde9-7861-4780-9008-cbbec61ffce8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:48.422463 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da62fde9-7861-4780-9008-cbbec61ffce8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:48.422892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da62fde9-7861-4780-9008-cbbec61ffce8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:48.553075 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-da62fde9-7861-4780-9008-cbbec61ffce8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:48.560658 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-da62fde9-7861-4780-9008-cbbec61ffce8 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.150500 Jun 22 11:52:48.561221 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 333/716] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:48 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:49.579619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-58145497-6246-4045-ade5-c5a3d592ec3b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:49.580427 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-58145497-6246-4045-ade5-c5a3d592ec3b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:49.588772 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58145497-6246-4045-ade5-c5a3d592ec3b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:49.589369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58145497-6246-4045-ade5-c5a3d592ec3b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:49.590926 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58145497-6246-4045-ade5-c5a3d592ec3b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:49.591374 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-58145497-6246-4045-ade5-c5a3d592ec3b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:49.718408 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-58145497-6246-4045-ade5-c5a3d592ec3b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:49.725976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-58145497-6246-4045-ade5-c5a3d592ec3b tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.151926 Jun 22 11:52:49.726534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 384/717] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:49 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:50.743787 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-789e9735-a800-46c2-ac80-7c6e2d4f2c0d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:50.744407 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-789e9735-a800-46c2-ac80-7c6e2d4f2c0d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:50.751452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-789e9735-a800-46c2-ac80-7c6e2d4f2c0d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:50.751892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-789e9735-a800-46c2-ac80-7c6e2d4f2c0d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:50.753169 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-789e9735-a800-46c2-ac80-7c6e2d4f2c0d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:50.753169 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-789e9735-a800-46c2-ac80-7c6e2d4f2c0d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:50.757101 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:52:50.886678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-789e9735-a800-46c2-ac80-7c6e2d4f2c0d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:50.896028 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-789e9735-a800-46c2-ac80-7c6e2d4f2c0d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.155984 Jun 22 11:52:50.896597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 334/718] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:50 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:51.913400 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2c790442-747e-4fec-b75f-c6c2e7086b97 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:51.914030 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2c790442-747e-4fec-b75f-c6c2e7086b97 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:51.920585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c790442-747e-4fec-b75f-c6c2e7086b97 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:51.921022 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c790442-747e-4fec-b75f-c6c2e7086b97 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:51.921767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c790442-747e-4fec-b75f-c6c2e7086b97 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:51.922190 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2c790442-747e-4fec-b75f-c6c2e7086b97 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:52.052610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2c790442-747e-4fec-b75f-c6c2e7086b97 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:52.054752 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=89 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:52:52.062033 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2c790442-747e-4fec-b75f-c6c2e7086b97 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.152409 Jun 22 11:52:52.062595 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 385/719] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:51 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:53.079869 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9ad0a084-c583-4e69-a5cd-1e11f7dd830a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:53.080483 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9ad0a084-c583-4e69-a5cd-1e11f7dd830a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:53.082761 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=33 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:52:53.088209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ad0a084-c583-4e69-a5cd-1e11f7dd830a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:53.088658 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ad0a084-c583-4e69-a5cd-1e11f7dd830a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:53.089416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ad0a084-c583-4e69-a5cd-1e11f7dd830a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:53.089855 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9ad0a084-c583-4e69-a5cd-1e11f7dd830a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:53.225278 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9ad0a084-c583-4e69-a5cd-1e11f7dd830a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:53.233445 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9ad0a084-c583-4e69-a5cd-1e11f7dd830a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.157464 Jun 22 11:52:53.234015 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 335/720] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:53 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:54.250871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-388120d4-73d6-44b0-ae4d-54815eb9d910 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:54.251430 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-388120d4-73d6-44b0-ae4d-54815eb9d910 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:54.253245 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=31 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:52:54.258634 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-388120d4-73d6-44b0-ae4d-54815eb9d910 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:54.259071 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-388120d4-73d6-44b0-ae4d-54815eb9d910 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:54.260351 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-388120d4-73d6-44b0-ae4d-54815eb9d910 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:54.260351 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-388120d4-73d6-44b0-ae4d-54815eb9d910 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:54.394423 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-388120d4-73d6-44b0-ae4d-54815eb9d910 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:54.402592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-388120d4-73d6-44b0-ae4d-54815eb9d910 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.156318 Jun 22 11:52:54.403170 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 386/721] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:54 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:52:55.422120 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8e2ddc45-e51d-4920-9785-920842baefc6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:55.422747 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8e2ddc45-e51d-4920-9785-920842baefc6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:55.430785 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e2ddc45-e51d-4920-9785-920842baefc6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:55.431565 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e2ddc45-e51d-4920-9785-920842baefc6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:55.432741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e2ddc45-e51d-4920-9785-920842baefc6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:55.433382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e2ddc45-e51d-4920-9785-920842baefc6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:55.573686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8e2ddc45-e51d-4920-9785-920842baefc6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:55.581660 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8e2ddc45-e51d-4920-9785-920842baefc6 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.165771 Jun 22 11:52:55.582212 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 336/722] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:55 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:55.976835 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-fef45358-5842-4a41-b32c-3ed574075120 req-5a275974-120a-419b-a199-cedf81f5d9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3eb4a54-d3df-4eca-b1ef-3dcb13716d61", "name": "network-vif-plugged", "status": "completed", "tag": "372fe7e2-a11e-410a-ad0b-3ed41c865845"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:52:55.988819 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-fef45358-5842-4a41-b32c-3ed574075120 req-5a275974-120a-419b-a199-cedf81f5d9ee service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:55.989375 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-fef45358-5842-4a41-b32c-3ed574075120 req-5a275974-120a-419b-a199-cedf81f5d9ee service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:56.001686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-fef45358-5842-4a41-b32c-3ed574075120 req-5a275974-120a-419b-a199-cedf81f5d9ee service nova] Creating event network-vif-plugged:372fe7e2-a11e-410a-ad0b-3ed41c865845 for instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 on hv-cinder-83697 Jun 22 11:52:56.006823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-fef45358-5842-4a41-b32c-3ed574075120 req-5a275974-120a-419b-a199-cedf81f5d9ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035661 Jun 22 11:52:56.007719 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 387/723] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:52:56.598071 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2d60dbed-d810-469d-aea8-7e9c7f1f6686 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:56.598596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2d60dbed-d810-469d-aea8-7e9c7f1f6686 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:56.604885 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d60dbed-d810-469d-aea8-7e9c7f1f6686 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:56.605320 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d60dbed-d810-469d-aea8-7e9c7f1f6686 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:56.606063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d60dbed-d810-469d-aea8-7e9c7f1f6686 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:56.606490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d60dbed-d810-469d-aea8-7e9c7f1f6686 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:56.734970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2d60dbed-d810-469d-aea8-7e9c7f1f6686 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:56.742974 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2d60dbed-d810-469d-aea8-7e9c7f1f6686 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.148834 Jun 22 11:52:56.743569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 337/724] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:56 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:57.760941 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3ad53f25-ee6f-4fb1-a2a0-b3b7b185084a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:57.761652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3ad53f25-ee6f-4fb1-a2a0-b3b7b185084a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:57.768740 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ad53f25-ee6f-4fb1-a2a0-b3b7b185084a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:57.769182 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ad53f25-ee6f-4fb1-a2a0-b3b7b185084a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:57.769933 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ad53f25-ee6f-4fb1-a2a0-b3b7b185084a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:57.770361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ad53f25-ee6f-4fb1-a2a0-b3b7b185084a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:57.902516 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3ad53f25-ee6f-4fb1-a2a0-b3b7b185084a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:57.910143 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3ad53f25-ee6f-4fb1-a2a0-b3b7b185084a tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1575 microversion: 2.1 time: 0.153385 Jun 22 11:52:57.910735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 388/725] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:57 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:52:58.928020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b13d5aa0-b60c-4e47-bc0b-8bacae93117d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:52:58.928623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b13d5aa0-b60c-4e47-bc0b-8bacae93117d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:52:58.936134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13d5aa0-b60c-4e47-bc0b-8bacae93117d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:58.936572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13d5aa0-b60c-4e47-bc0b-8bacae93117d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:58.937332 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13d5aa0-b60c-4e47-bc0b-8bacae93117d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:52:58.937790 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13d5aa0-b60c-4e47-bc0b-8bacae93117d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:52:59.067073 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b13d5aa0-b60c-4e47-bc0b-8bacae93117d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:52:59.074767 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b13d5aa0-b60c-4e47-bc0b-8bacae93117d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1562 microversion: 2.1 time: 0.150591 Jun 22 11:52:59.075356 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 338/726] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:52:58 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:08.899862 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-04624827-865d-404c-b635-c20b8e262a4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:08.900401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-04624827-865d-404c-b635-c20b8e262a4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:08.902424 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=5 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:08.903092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=15 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:08.909536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04624827-865d-404c-b635-c20b8e262a4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:08.909978 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04624827-865d-404c-b635-c20b8e262a4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:08.910735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04624827-865d-404c-b635-c20b8e262a4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:08.911167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-04624827-865d-404c-b635-c20b8e262a4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:08.989951 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-04624827-865d-404c-b635-c20b8e262a4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lazy-loading 'services' on Instance uuid 917f312d-2bff-4f24-b5ee-5009132047cd {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:53:09.061857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-04624827-865d-404c-b635-c20b8e262a4e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "DELETE /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments/81de4c09-8497-4418-9d87-8dcad11969c4" status: 202 len: 0 microversion: 2.1 time: 0.165136 Jun 22 11:53:09.062619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 389/727] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 11:53:08 2022] DELETE /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments/81de4c09-8497-4418-9d87-8dcad11969c4 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:53:09.071692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8e250cbf-b038-46be-93ee-7440434971e4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:09.073204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8e250cbf-b038-46be-93ee-7440434971e4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:09.077309 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=7 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:09.077936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=28 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:09.083001 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e250cbf-b038-46be-93ee-7440434971e4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:09.083576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e250cbf-b038-46be-93ee-7440434971e4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:09.084874 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e250cbf-b038-46be-93ee-7440434971e4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:09.085404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e250cbf-b038-46be-93ee-7440434971e4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:09.120767 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8e250cbf-b038-46be-93ee-7440434971e4 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053685 Jun 22 11:53:09.121357 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 339/728] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:53:09 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:10.133364 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5a6efd05-d59f-4e6e-ba76-edbd727e632a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:10.134444 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5a6efd05-d59f-4e6e-ba76-edbd727e632a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:10.141580 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5a6efd05-d59f-4e6e-ba76-edbd727e632a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:10.142022 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5a6efd05-d59f-4e6e-ba76-edbd727e632a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:10.142780 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5a6efd05-d59f-4e6e-ba76-edbd727e632a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:10.143207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5a6efd05-d59f-4e6e-ba76-edbd727e632a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:10.176293 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5a6efd05-d59f-4e6e-ba76-edbd727e632a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047204 Jun 22 11:53:10.177135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 390/729] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:53:10 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:10.905725 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-18fde78b-c807-43a1-9d4a-a449f329d146 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:10.906214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-18fde78b-c807-43a1-9d4a-a449f329d146 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:10.912523 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-18fde78b-c807-43a1-9d4a-a449f329d146 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:10.912995 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-18fde78b-c807-43a1-9d4a-a449f329d146 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:10.913780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-18fde78b-c807-43a1-9d4a-a449f329d146 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:10.914209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-18fde78b-c807-43a1-9d4a-a449f329d146 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:10.944384 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-18fde78b-c807-43a1-9d4a-a449f329d146 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments/4b20ca35-9b91-472a-bf70-306f5cb998aa" status: 200 len: 194 microversion: 2.20 time: 0.138260 Jun 22 11:53:10.944506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 340/730] 10.222.0.36 () {60 vars in 1453 bytes} [Wed Jun 22 11:53:10 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments/4b20ca35-9b91-472a-bf70-306f5cb998aa => generated 194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:53:11.005128 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-dc6e4963-dc76-47f1-a1e3-644d9fe10698 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:11.005649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-dc6e4963-dc76-47f1-a1e3-644d9fe10698 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:11.011722 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dc6e4963-dc76-47f1-a1e3-644d9fe10698 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.012167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dc6e4963-dc76-47f1-a1e3-644d9fe10698 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.012924 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dc6e4963-dc76-47f1-a1e3-644d9fe10698 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.013625 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dc6e4963-dc76-47f1-a1e3-644d9fe10698 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.093067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-dc6e4963-dc76-47f1-a1e3-644d9fe10698 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lazy-loading 'services' on Instance uuid f5b85599-217c-4d95-a8ef-136d2368cf70 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:53:11.163246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-dc6e4963-dc76-47f1-a1e3-644d9fe10698 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments/4b20ca35-9b91-472a-bf70-306f5cb998aa" status: 202 len: 0 microversion: 2.20 time: 0.161869 Jun 22 11:53:11.164004 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 391/731] 10.222.0.36 () {60 vars in 1456 bytes} [Wed Jun 22 11:53:11 2022] DELETE /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments/4b20ca35-9b91-472a-bf70-306f5cb998aa => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:53:11.172323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8bd47c92-0463-4622-9136-d74cc706b6d1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:11.173238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8bd47c92-0463-4622-9136-d74cc706b6d1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:11.179062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8bd47c92-0463-4622-9136-d74cc706b6d1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.179751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8bd47c92-0463-4622-9136-d74cc706b6d1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.180556 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8bd47c92-0463-4622-9136-d74cc706b6d1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.181003 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8bd47c92-0463-4622-9136-d74cc706b6d1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.189122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-969c8c8d-8ed0-4d68-ab3f-acde79d29baf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:11.190133 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-969c8c8d-8ed0-4d68-ab3f-acde79d29baf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:11.198276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-969c8c8d-8ed0-4d68-ab3f-acde79d29baf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.198720 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-969c8c8d-8ed0-4d68-ab3f-acde79d29baf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.199629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-969c8c8d-8ed0-4d68-ab3f-acde79d29baf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.200131 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-969c8c8d-8ed0-4d68-ab3f-acde79d29baf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.211205 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8bd47c92-0463-4622-9136-d74cc706b6d1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042672 Jun 22 11:53:11.211994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 341/732] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 11:53:11 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:53:11.232270 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-969c8c8d-8ed0-4d68-ab3f-acde79d29baf tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047329 Jun 22 11:53:11.232814 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 392/733] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:53:11 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 11:53:11.310216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2e8820aa-9cb6-4117-a00f-67b4d67a7c7e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:11.310698 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2e8820aa-9cb6-4117-a00f-67b4d67a7c7e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:11.317183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2e8820aa-9cb6-4117-a00f-67b4d67a7c7e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.317619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2e8820aa-9cb6-4117-a00f-67b4d67a7c7e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.318421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2e8820aa-9cb6-4117-a00f-67b4d67a7c7e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.318785 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2e8820aa-9cb6-4117-a00f-67b4d67a7c7e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.343161 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2e8820aa-9cb6-4117-a00f-67b4d67a7c7e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:53:11.419600 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2e8820aa-9cb6-4117-a00f-67b4d67a7c7e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "DELETE /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 204 len: 0 microversion: 2.1 time: 0.112936 Jun 22 11:53:11.420440 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 342/734] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:53:11 2022] DELETE /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:53:11.432431 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-dd890658-6117-4d42-aeb0-77aaa5df4c33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:11.433153 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-dd890658-6117-4d42-aeb0-77aaa5df4c33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:11.440011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dd890658-6117-4d42-aeb0-77aaa5df4c33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.440582 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dd890658-6117-4d42-aeb0-77aaa5df4c33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.441441 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dd890658-6117-4d42-aeb0-77aaa5df4c33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:11.441874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dd890658-6117-4d42-aeb0-77aaa5df4c33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:11.574233 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-dd890658-6117-4d42-aeb0-77aaa5df4c33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:11.582231 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-dd890658-6117-4d42-aeb0-77aaa5df4c33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1688 microversion: 2.1 time: 0.153833 Jun 22 11:53:11.582788 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 393/735] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:11 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:12.223911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5be5fd3a-cf2e-45ff-8e71-3cf47392df9a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:12.224817 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5be5fd3a-cf2e-45ff-8e71-3cf47392df9a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:12.231152 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5be5fd3a-cf2e-45ff-8e71-3cf47392df9a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:12.231616 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5be5fd3a-cf2e-45ff-8e71-3cf47392df9a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:12.232370 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5be5fd3a-cf2e-45ff-8e71-3cf47392df9a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:12.232820 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5be5fd3a-cf2e-45ff-8e71-3cf47392df9a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:12.262068 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5be5fd3a-cf2e-45ff-8e71-3cf47392df9a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042604 Jun 22 11:53:12.262612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 343/736] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 11:53:12 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:53:12.599292 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-324b048f-5598-407f-ab03-9fa6b7b19d12 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:12.600002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-324b048f-5598-407f-ab03-9fa6b7b19d12 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:12.605793 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-324b048f-5598-407f-ab03-9fa6b7b19d12 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:12.606348 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-324b048f-5598-407f-ab03-9fa6b7b19d12 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:12.607103 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-324b048f-5598-407f-ab03-9fa6b7b19d12 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:12.607849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-324b048f-5598-407f-ab03-9fa6b7b19d12 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:12.735762 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-324b048f-5598-407f-ab03-9fa6b7b19d12 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:12.743818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-324b048f-5598-407f-ab03-9fa6b7b19d12 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1688 microversion: 2.1 time: 0.148347 Jun 22 11:53:12.744383 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 394/737] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:12 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:13.274270 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-120c3670-3857-40c4-b669-5ad5f91a940a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:13.275080 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-120c3670-3857-40c4-b669-5ad5f91a940a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:13.281481 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-120c3670-3857-40c4-b669-5ad5f91a940a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:13.281915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-120c3670-3857-40c4-b669-5ad5f91a940a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:13.283253 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-120c3670-3857-40c4-b669-5ad5f91a940a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:13.283702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-120c3670-3857-40c4-b669-5ad5f91a940a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:13.315167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-120c3670-3857-40c4-b669-5ad5f91a940a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044935 Jun 22 11:53:13.315763 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 344/738] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 11:53:13 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:53:13.760856 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bc5b6636-4800-4ea9-835c-320a1f404493 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:13.761458 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bc5b6636-4800-4ea9-835c-320a1f404493 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:13.768365 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bc5b6636-4800-4ea9-835c-320a1f404493 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:13.768839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bc5b6636-4800-4ea9-835c-320a1f404493 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:13.769587 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bc5b6636-4800-4ea9-835c-320a1f404493 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:13.770014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bc5b6636-4800-4ea9-835c-320a1f404493 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:13.897320 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bc5b6636-4800-4ea9-835c-320a1f404493 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:13.905014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bc5b6636-4800-4ea9-835c-320a1f404493 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1688 microversion: 2.1 time: 0.147946 Jun 22 11:53:13.905567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 395/739] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:13 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:14.329516 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-00d8b9a7-a0b0-424b-99eb-60fc6a2b40d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:14.330337 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-00d8b9a7-a0b0-424b-99eb-60fc6a2b40d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:14.339000 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00d8b9a7-a0b0-424b-99eb-60fc6a2b40d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:14.339477 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00d8b9a7-a0b0-424b-99eb-60fc6a2b40d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:14.340226 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00d8b9a7-a0b0-424b-99eb-60fc6a2b40d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:14.340647 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00d8b9a7-a0b0-424b-99eb-60fc6a2b40d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:14.369156 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-00d8b9a7-a0b0-424b-99eb-60fc6a2b40d6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044140 Jun 22 11:53:14.369711 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 345/740] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 11:53:14 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:53:14.921652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c1155e21-a467-4c11-b2e1-48f68c44b415 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:14.922282 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c1155e21-a467-4c11-b2e1-48f68c44b415 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:14.928901 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c1155e21-a467-4c11-b2e1-48f68c44b415 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:14.929347 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c1155e21-a467-4c11-b2e1-48f68c44b415 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:14.930337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c1155e21-a467-4c11-b2e1-48f68c44b415 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:14.930972 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c1155e21-a467-4c11-b2e1-48f68c44b415 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.067065 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c1155e21-a467-4c11-b2e1-48f68c44b415 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:15.074830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c1155e21-a467-4c11-b2e1-48f68c44b415 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1688 microversion: 2.1 time: 0.157020 Jun 22 11:53:15.075404 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 396/741] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:14 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:15.381391 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-85c0c29e-d3e9-4714-a7dd-dc504f7ccd19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:15.382210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-85c0c29e-d3e9-4714-a7dd-dc504f7ccd19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:15.389994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-85c0c29e-d3e9-4714-a7dd-dc504f7ccd19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.390437 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-85c0c29e-d3e9-4714-a7dd-dc504f7ccd19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.391199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-85c0c29e-d3e9-4714-a7dd-dc504f7ccd19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.391649 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-85c0c29e-d3e9-4714-a7dd-dc504f7ccd19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.421543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-85c0c29e-d3e9-4714-a7dd-dc504f7ccd19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044908 Jun 22 11:53:15.422089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 346/742] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 11:53:15 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:15.482760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c2f2d33e-5145-46df-b540-6f6d7d796436 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:15.483464 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c2f2d33e-5145-46df-b540-6f6d7d796436 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:15.490181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c2f2d33e-5145-46df-b540-6f6d7d796436 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.490624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c2f2d33e-5145-46df-b540-6f6d7d796436 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.491421 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c2f2d33e-5145-46df-b540-6f6d7d796436 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.492227 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c2f2d33e-5145-46df-b540-6f6d7d796436 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.517778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c2f2d33e-5145-46df-b540-6f6d7d796436 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:53:15.595125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c2f2d33e-5145-46df-b540-6f6d7d796436 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 204 len: 0 microversion: 2.20 time: 0.116066 Jun 22 11:53:15.596345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 397/743] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Jun 22 11:53:15 2022] DELETE /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 11:53:15.604206 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:15.605043 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:15.611453 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.612705 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.613472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.613901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.834160 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-16a54e7b-e881-4341-90e8-67875361b8bd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:15.835373 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-16a54e7b-e881-4341-90e8-67875361b8bd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:15.841575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-16a54e7b-e881-4341-90e8-67875361b8bd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.842025 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-16a54e7b-e881-4341-90e8-67875361b8bd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.842801 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-16a54e7b-e881-4341-90e8-67875361b8bd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.843233 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-16a54e7b-e881-4341-90e8-67875361b8bd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.872508 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-16a54e7b-e881-4341-90e8-67875361b8bd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042741 Jun 22 11:53:15.873081 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 398/744] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:53:15 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 11:53:15.892622 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:15.900752 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:15.902269 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:15.903465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3f4e3bea-c1ae-43e2-ba52-3e29ab1e3f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.303099 Jun 22 11:53:15.904558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 347/745] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:15 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:15.940183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e1c21624-4667-4974-90c1-d180cd098a94 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:15.940738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e1c21624-4667-4974-90c1-d180cd098a94 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:15.946727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e1c21624-4667-4974-90c1-d180cd098a94 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.947165 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e1c21624-4667-4974-90c1-d180cd098a94 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.947962 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e1c21624-4667-4974-90c1-d180cd098a94 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:15.948472 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e1c21624-4667-4974-90c1-d180cd098a94 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:15.973420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e1c21624-4667-4974-90c1-d180cd098a94 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:53:16.049034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e1c21624-4667-4974-90c1-d180cd098a94 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 204 len: 0 microversion: 2.1 time: 0.112403 Jun 22 11:53:16.050199 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 399/746] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:53:15 2022] DELETE /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:53:16.058263 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-67eee3fb-fa5e-43f1-9860-e30f47d0150d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:16.058872 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-67eee3fb-fa5e-43f1-9860-e30f47d0150d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:16.064902 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67eee3fb-fa5e-43f1-9860-e30f47d0150d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:16.065341 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67eee3fb-fa5e-43f1-9860-e30f47d0150d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:16.066115 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67eee3fb-fa5e-43f1-9860-e30f47d0150d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:16.066538 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67eee3fb-fa5e-43f1-9860-e30f47d0150d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:16.092774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3617f688-230f-44de-b4a9-54a76b1e6ca6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:16.093492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3617f688-230f-44de-b4a9-54a76b1e6ca6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:16.100447 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3617f688-230f-44de-b4a9-54a76b1e6ca6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:16.100949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3617f688-230f-44de-b4a9-54a76b1e6ca6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:16.101781 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3617f688-230f-44de-b4a9-54a76b1e6ca6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:16.102270 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3617f688-230f-44de-b4a9-54a76b1e6ca6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:16.218775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3617f688-230f-44de-b4a9-54a76b1e6ca6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:16.222932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:16.227293 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3617f688-230f-44de-b4a9-54a76b1e6ca6 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1621 microversion: 2.1 time: 0.138874 Jun 22 11:53:16.227914 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 400/747] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:16 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1621 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:16.357702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-67eee3fb-fa5e-43f1-9860-e30f47d0150d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:16.366655 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-67eee3fb-fa5e-43f1-9860-e30f47d0150d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1675 microversion: 2.1 time: 0.312081 Jun 22 11:53:16.367237 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 348/748] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:16 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1675 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:16.537681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-6b1b13ce-51ab-4f51-adf4-5b27f88b66f7 req-ed77c4d8-ad54-4567-9c42-5334df221974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917f312d-2bff-4f24-b5ee-5009132047cd", "name": "network-vif-deleted", "tag": "18b5b430-c735-4878-a26d-6c754a8d3c06"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:16.546198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-6b1b13ce-51ab-4f51-adf4-5b27f88b66f7 req-ed77c4d8-ad54-4567-9c42-5334df221974 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:16.546642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-6b1b13ce-51ab-4f51-adf4-5b27f88b66f7 req-ed77c4d8-ad54-4567-9c42-5334df221974 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:16.558566 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-6b1b13ce-51ab-4f51-adf4-5b27f88b66f7 req-ed77c4d8-ad54-4567-9c42-5334df221974 service nova] Creating event network-vif-deleted:18b5b430-c735-4878-a26d-6c754a8d3c06 for instance 917f312d-2bff-4f24-b5ee-5009132047cd on hv-cinder-83697 Jun 22 11:53:16.563498 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-6b1b13ce-51ab-4f51-adf4-5b27f88b66f7 req-ed77c4d8-ad54-4567-9c42-5334df221974 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029506 Jun 22 11:53:16.564087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 401/749] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:16.923133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:16.923978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:16.934360 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:16.934805 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:16.935599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:16.936027 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:17.081996 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:17.090265 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:17.091851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:17.092982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6ceb81ce-5813-46ca-a4db-5ef9e08cad70 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.174262 Jun 22 11:53:17.093539 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 349/750] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:16 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:17.244931 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-160bb6c2-35ea-4399-9dfa-555826302144 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:17.245620 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-160bb6c2-35ea-4399-9dfa-555826302144 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:17.252870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-160bb6c2-35ea-4399-9dfa-555826302144 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:17.253311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-160bb6c2-35ea-4399-9dfa-555826302144 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:17.254079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-160bb6c2-35ea-4399-9dfa-555826302144 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:17.254506 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-160bb6c2-35ea-4399-9dfa-555826302144 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:17.325160 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-160bb6c2-35ea-4399-9dfa-555826302144 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:17.333548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-160bb6c2-35ea-4399-9dfa-555826302144 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1329 microversion: 2.1 time: 0.092688 Jun 22 11:53:17.334041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 402/751] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:17 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:17.384503 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-18d3ebf5-27c0-4d48-a983-2f2aa39237ae tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:17.385112 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-18d3ebf5-27c0-4d48-a983-2f2aa39237ae tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:17.391623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-18d3ebf5-27c0-4d48-a983-2f2aa39237ae tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:17.392070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-18d3ebf5-27c0-4d48-a983-2f2aa39237ae tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:17.392849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-18d3ebf5-27c0-4d48-a983-2f2aa39237ae tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:17.393955 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-18d3ebf5-27c0-4d48-a983-2f2aa39237ae tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:17.528876 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-18d3ebf5-27c0-4d48-a983-2f2aa39237ae tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:17.536943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-18d3ebf5-27c0-4d48-a983-2f2aa39237ae tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1675 microversion: 2.1 time: 0.156342 Jun 22 11:53:17.537749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 350/752] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:17 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:18.112749 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:18.113306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:18.119241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:18.119724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:18.120485 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:18.120910 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:18.271462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:18.279807 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:18.281322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:18.282488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ef77ef7d-cd59-47f9-b156-137fd638a102 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.174392 Jun 22 11:53:18.283048 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 403/753] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:18 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:18.350609 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a0e8ea67-a2d0-4f31-919c-432f8692ec92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:18.351215 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a0e8ea67-a2d0-4f31-919c-432f8692ec92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:18.358095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a0e8ea67-a2d0-4f31-919c-432f8692ec92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:18.358535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a0e8ea67-a2d0-4f31-919c-432f8692ec92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:18.359301 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a0e8ea67-a2d0-4f31-919c-432f8692ec92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:18.359762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a0e8ea67-a2d0-4f31-919c-432f8692ec92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:18.427339 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-a0e8ea67-a2d0-4f31-919c-432f8692ec92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:18.435813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a0e8ea67-a2d0-4f31-919c-432f8692ec92 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 200 len: 1329 microversion: 2.1 time: 0.089604 Jun 22 11:53:18.445145 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 351/754] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:18 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 1329 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:18.555640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6d2c8bc5-f9f0-436a-ad10-e38dadc70e12 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:18.556492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6d2c8bc5-f9f0-436a-ad10-e38dadc70e12 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:18.562622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6d2c8bc5-f9f0-436a-ad10-e38dadc70e12 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:18.563147 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6d2c8bc5-f9f0-436a-ad10-e38dadc70e12 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:18.564029 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6d2c8bc5-f9f0-436a-ad10-e38dadc70e12 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:18.564552 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6d2c8bc5-f9f0-436a-ad10-e38dadc70e12 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:18.705689 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6d2c8bc5-f9f0-436a-ad10-e38dadc70e12 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:18.713482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6d2c8bc5-f9f0-436a-ad10-e38dadc70e12 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1675 microversion: 2.1 time: 0.162004 Jun 22 11:53:18.714080 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 404/755] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:18 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:19.301944 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:19.302707 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:19.309957 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:19.312054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:19.313072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:19.313711 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:19.452863 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:19.453466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 917f312d-2bff-4f24-b5ee-5009132047cd] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:19.460861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:19.461617 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:19.462394 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:19.462823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:19.476727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] HTTP exception thrown: Instance 917f312d-2bff-4f24-b5ee-5009132047cd could not be found. Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Request method failure captured: Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd HTTP/1.1 Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDQxWzIxo8L5QrqUkiWxFb74S_4r3NBQOJ4hKUuQsgRXMFyN-xWyQGiIP0dyUdqvS5aykt2GDDGJWzhMBWy1CiaPbE9Ss9zKyf_rUf2kDN7EST2rbUklHXeBv05p1XtQ6cRoUK9eZw2b2e4Lejk_iT-ELbafxVWciapxpL1eJB2NUo Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:53:19.478403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20536d2fa444e97b7184c10e52d5cc5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 27cc3d38926f470c91eeb6aecfc86a48 Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 917f312d-2bff-4f24-b5ee-5009132047cd could not be found. Jun 22 11:53:19.480123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '917f312d-2bff-4f24-b5ee-5009132047cd'} Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917f312d-2bff-4f24-b5ee-5009132047cd could not be found. Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:53:19.481069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917f312d-2bff-4f24-b5ee-5009132047cd could not be found. Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917f312d-2bff-4f24-b5ee-5009132047cd could not be found. Jun 22 11:53:19.482686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:19.484425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Returning 404 to user: Instance 917f312d-2bff-4f24-b5ee-5009132047cd could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:53:19.484425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9afc7ae2-9c35-48b8-8c7e-09d3cdfe1918 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd" status: 404 len: 111 microversion: 2.1 time: 0.030814 Jun 22 11:53:19.484425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 405/756] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:19 2022] GET /compute/v2.1/servers/917f312d-2bff-4f24-b5ee-5009132047cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:53:19.488281 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fc922a9b-f658-49cc-9479-10a0137fd764 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '.version_select at 0x7f3ea80ed790>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:19.491917 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc922a9b-f658-49cc-9479-10a0137fd764 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [54807073-ede7-405f-bd5a-13230c26c203] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 11:53:19.530780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:19.545327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:19.547261 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:19.548557 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6af2995d-1f0e-4e23-ad38-5ffb2c18c25d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1723 microversion: 2.20 time: 0.250607 Jun 22 11:53:19.549528 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 352/757] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:19 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:19.732504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8dcdb273-aa89-4caf-975b-5b63064a27f4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:19.733114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8dcdb273-aa89-4caf-975b-5b63064a27f4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:19.740267 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8dcdb273-aa89-4caf-975b-5b63064a27f4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:19.740713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8dcdb273-aa89-4caf-975b-5b63064a27f4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:19.741494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8dcdb273-aa89-4caf-975b-5b63064a27f4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:19.741926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8dcdb273-aa89-4caf-975b-5b63064a27f4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:19.882463 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8dcdb273-aa89-4caf-975b-5b63064a27f4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:19.886305 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:19.891974 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8dcdb273-aa89-4caf-975b-5b63064a27f4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1675 microversion: 2.1 time: 0.163505 Jun 22 11:53:19.892680 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 353/758] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:19 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:53:20.011989 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-390026b4-5a00-4d9a-b0d0-1fb608744302 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1200915113"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:20.012619 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-390026b4-5a00-4d9a-b0d0-1fb608744302 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:20.021113 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-390026b4-5a00-4d9a-b0d0-1fb608744302 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.021685 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-390026b4-5a00-4d9a-b0d0-1fb608744302 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:20.022527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-390026b4-5a00-4d9a-b0d0-1fb608744302 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.023013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-390026b4-5a00-4d9a-b0d0-1fb608744302 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:20.195393 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.network.security_group_api [None req-390026b4-5a00-4d9a-b0d0-1fb608744302 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Removing security group 232c239a-258f-44e0-8358-447027d11f03 from port a4726067-df3c-4a9b-939a-61e6fd9345db Jun 22 11:53:20.500095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc922a9b-f658-49cc-9479-10a0137fd764 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [54807073-ede7-405f-bd5a-13230c26c203] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49858. Jun 22 11:53:20.531128 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fc922a9b-f658-49cc-9479-10a0137fd764 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437700771" status: 202 len: 0 microversion: 2.1 time: 1.045671 Jun 22 11:53:20.535996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 406/759] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Jun 22 11:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437700771 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:53:20.608856 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-add47282-0904-40e3-80d3-5ad6c9054f63 req-88177e52-3c08-43d6-9330-50d82548fe7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b85599-217c-4d95-a8ef-136d2368cf70", "name": "network-vif-deleted", "tag": "4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:20.625106 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-add47282-0904-40e3-80d3-5ad6c9054f63 req-88177e52-3c08-43d6-9330-50d82548fe7d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.625879 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-add47282-0904-40e3-80d3-5ad6c9054f63 req-88177e52-3c08-43d6-9330-50d82548fe7d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:20.637630 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-add47282-0904-40e3-80d3-5ad6c9054f63 req-88177e52-3c08-43d6-9330-50d82548fe7d service nova] Creating event network-vif-deleted:4fbe1fea-fd3a-4094-8c8f-f943df2e4ce6 for instance f5b85599-217c-4d95-a8ef-136d2368cf70 on hv-cinder-83697 Jun 22 11:53:20.645272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-add47282-0904-40e3-80d3-5ad6c9054f63 req-88177e52-3c08-43d6-9330-50d82548fe7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107970 Jun 22 11:53:20.646094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 407/760] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:20.651857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:20.652849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:20.663631 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.664575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:20.665614 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.666169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:20.723310 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.724466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:20.724815 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lazy-loading 'fault' on Instance uuid f5b85599-217c-4d95-a8ef-136d2368cf70 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:53:20.848335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:20.859695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:20.862837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:20.864597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-eb42546b-d4f5-4979-8ba3-fa962e81cc40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 200 len: 1372 microversion: 2.20 time: 0.217171 Jun 22 11:53:20.866509 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 408/761] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:20 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:20.896829 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-390026b4-5a00-4d9a-b0d0-1fb608744302 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "POST /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/action" status: 202 len: 0 microversion: 2.1 time: 1.001598 Jun 22 11:53:20.902865 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 354/762] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 11:53:19 2022] POST /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/action => generated 0 bytes in 1009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:53:20.912246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-668ed734-9d32-4e07-96c1-4c162425c761 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:20.913153 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-668ed734-9d32-4e07-96c1-4c162425c761 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:20.926447 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-1dc8553b-6451-4a65-adea-10091a11f248 req-962bdc7d-c2c8-450d-a0b4-0eb14417edee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3e9cd1-e3da-436f-a4e7-f6c953c83df4", "tag": "a4726067-df3c-4a9b-939a-61e6fd9345db"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:20.927711 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-668ed734-9d32-4e07-96c1-4c162425c761 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.928210 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-668ed734-9d32-4e07-96c1-4c162425c761 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:20.929021 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-668ed734-9d32-4e07-96c1-4c162425c761 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.932102 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-668ed734-9d32-4e07-96c1-4c162425c761 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:20.946552 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-1dc8553b-6451-4a65-adea-10091a11f248 req-962bdc7d-c2c8-450d-a0b4-0eb14417edee service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:20.947016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-1dc8553b-6451-4a65-adea-10091a11f248 req-962bdc7d-c2c8-450d-a0b4-0eb14417edee service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:21.007837 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-1dc8553b-6451-4a65-adea-10091a11f248 req-962bdc7d-c2c8-450d-a0b4-0eb14417edee service nova] Creating event network-changed:a4726067-df3c-4a9b-939a-61e6fd9345db for instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 on hv-cinder-83697 Jun 22 11:53:21.022560 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-1dc8553b-6451-4a65-adea-10091a11f248 req-962bdc7d-c2c8-450d-a0b4-0eb14417edee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100157 Jun 22 11:53:21.023169 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 355/763] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:53:21.202601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-668ed734-9d32-4e07-96c1-4c162425c761 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:21.211556 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-668ed734-9d32-4e07-96c1-4c162425c761 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 200 len: 1608 microversion: 2.1 time: 0.305204 Jun 22 11:53:21.216208 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 409/764] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:20 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 1608 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:21.899510 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:21.900083 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:21.929380 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:21.930197 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:21.933906 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:21.936829 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:21.986256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] HTTP exception thrown: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Request method failure captured: Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 HTTP/1.1 Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswEuz90__KG4NaMuLrSw7iGMB7Jes-9BlrXMpKu3K9LMa_xFLGftoAg4HPrTIZha4KJs7qFsK9Vq06U1zgjTwh9sfHfZ6kfBTcJqwcC-ZZiVf87GbmAsoQPXDLDorRoZYHWT45FhdUldWLDJvSpkPBV0CBVmuil3jqt1SviIlhAWuj8 Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:53:21.990159 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f64ad44d3c247caa7d106861916f245", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 034858240ac34e549aa5e0754726f9c6 Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:53:21.991911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'f5b85599-217c-4d95-a8ef-136d2368cf70'} Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:53:21.992842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:53:21.994492 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:21.997585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Returning 404 to user: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:53:21.997585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f10d1849-c68d-451d-a2d9-b32ef1d31ccd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 404 len: 111 microversion: 2.20 time: 0.103928 Jun 22 11:53:21.997585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 356/765] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:21 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 11:53:22.009032 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b80ca827-20eb-4692-be44-7c8378006b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '.version_select at 0x7f3ea81f8790>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:22.047895 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b80ca827-20eb-4692-be44-7c8378006b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1191750830" status: 204 len: 0 microversion: 2.20 time: 0.046279 Jun 22 11:53:22.048913 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 410/766] 10.222.0.36 () {60 vars in 1261 bytes} [Wed Jun 22 11:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1191750830 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 11:53:22.234012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:22.234745 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:22.246858 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:22.247745 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:22.249945 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:22.250564 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:22.290335 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] HTTP exception thrown: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Request method failure captured: Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 HTTP/1.1 Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswDNMSQMDiSmxCN4-CiUM371W5wtLjYPqgv_H9i7sLRWyN-mcFoeJIlt9wYicdbN2I7AsZDno8rwgh7MwSqkehthIGECk2230M1pEekyMsI_68eO0yhZpOIIgWQ67bpNl6ZsLhgrriqI971XCzjcW_QihdCPc3U62fZBxGTYjHzb3SU Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:53:22.294167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_878b71f291ec4107a09e3109b6acc40b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 4d7c1adbb2ad456eaf5793a15d6fcb4b Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:53:22.295788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'af6ebc0a-848b-4688-939a-062ccc6dc352'} Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:53:22.296738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:53:22.298116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:22.300041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Returning 404 to user: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:53:22.300041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0072e055-9f33-4e01-b640-10b99f4b2ca7 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 404 len: 111 microversion: 2.1 time: 0.072051 Jun 22 11:53:22.306452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 357/767] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:22 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:53:22.314432 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-27f581e5-1ad3-4811-bec7-f47a98b6771e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '.version_select at 0x7f3ea820dee0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:22.349867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-27f581e5-1ad3-4811-bec7-f47a98b6771e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600561222" status: 202 len: 0 microversion: 2.1 time: 0.041741 Jun 22 11:53:22.353927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 411/768] 10.222.0.36 () {58 vars in 1220 bytes} [Wed Jun 22 11:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600561222 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:53:22.687976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-6377e5d2-de95-4239-847e-c638ae0e357c req-fdff7718-1ceb-429d-8eef-7767bc8471b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6ebc0a-848b-4688-939a-062ccc6dc352", "name": "network-vif-deleted", "tag": "f2a96738-75af-44d5-9821-e335309678f0"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:22.701984 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-6377e5d2-de95-4239-847e-c638ae0e357c req-fdff7718-1ceb-429d-8eef-7767bc8471b6 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:22.703796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-6377e5d2-de95-4239-847e-c638ae0e357c req-fdff7718-1ceb-429d-8eef-7767bc8471b6 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:22.722357 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-6377e5d2-de95-4239-847e-c638ae0e357c req-fdff7718-1ceb-429d-8eef-7767bc8471b6 service nova] Creating event network-vif-deleted:f2a96738-75af-44d5-9821-e335309678f0 for instance af6ebc0a-848b-4688-939a-062ccc6dc352 on hv-cinder-83697 Jun 22 11:53:22.728228 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-6377e5d2-de95-4239-847e-c638ae0e357c req-fdff7718-1ceb-429d-8eef-7767bc8471b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044287 Jun 22 11:53:22.730249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 358/769] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:23.051587 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-60704982-4529-4247-9c54-5cb60d079c36 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:23.052161 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-60704982-4529-4247-9c54-5cb60d079c36 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:23.058124 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-9178cd79-6d5b-404b-adc3-da3fa0a7a632 req-399f0542-79a9-4837-92bd-2f95bf621409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3e9cd1-e3da-436f-a4e7-f6c953c83df4", "tag": "a4726067-df3c-4a9b-939a-61e6fd9345db"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:23.067090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-60704982-4529-4247-9c54-5cb60d079c36 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:23.067500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-60704982-4529-4247-9c54-5cb60d079c36 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:23.070965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-60704982-4529-4247-9c54-5cb60d079c36 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:23.071710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-9178cd79-6d5b-404b-adc3-da3fa0a7a632 req-399f0542-79a9-4837-92bd-2f95bf621409 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:23.074836 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-60704982-4529-4247-9c54-5cb60d079c36 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:23.075230 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-9178cd79-6d5b-404b-adc3-da3fa0a7a632 req-399f0542-79a9-4837-92bd-2f95bf621409 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:23.110347 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-9178cd79-6d5b-404b-adc3-da3fa0a7a632 req-399f0542-79a9-4837-92bd-2f95bf621409 service nova] Creating event network-changed:a4726067-df3c-4a9b-939a-61e6fd9345db for instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 on hv-cinder-83697 Jun 22 11:53:23.116217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-9178cd79-6d5b-404b-adc3-da3fa0a7a632 req-399f0542-79a9-4837-92bd-2f95bf621409 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062416 Jun 22 11:53:23.120824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 359/770] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:53:23.217370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-60704982-4529-4247-9c54-5cb60d079c36 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lazy-loading 'services' on Instance uuid 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:53:23.322047 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-60704982-4529-4247-9c54-5cb60d079c36 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments/a10f720e-28d8-4a27-8dae-e0c775252572" status: 202 len: 0 microversion: 2.1 time: 0.274477 Jun 22 11:53:23.323466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 412/771] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 11:53:23 2022] DELETE /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments/a10f720e-28d8-4a27-8dae-e0c775252572 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:53:23.333770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-da1c5173-49c4-4904-8b9b-fe2477ae3789 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:23.335169 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-da1c5173-49c4-4904-8b9b-fe2477ae3789 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:23.344246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da1c5173-49c4-4904-8b9b-fe2477ae3789 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:23.344924 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da1c5173-49c4-4904-8b9b-fe2477ae3789 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:23.346234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da1c5173-49c4-4904-8b9b-fe2477ae3789 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:23.346663 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-da1c5173-49c4-4904-8b9b-fe2477ae3789 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:23.396184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-da1c5173-49c4-4904-8b9b-fe2477ae3789 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068275 Jun 22 11:53:23.396807 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 360/772] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:53:23 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:23.684651 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b9538121-4a18-46a6-9b4e-6f108f21fb50 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'create', calling method: .version_select at 0x7f3ea81f8af0>, body: {"keypair": {"name": "tempest-keypair-1189441356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBucBCnTlsgdU83OAcf4Ck/ljQ92lbEDYiKKWau0AKejvldnILIkr2DjxO4CebBY+wMkMvvMPxfHDlNGkvasEazcoaa0rBL/XIX1NGdoLe7ufF7iKCWHjAVbvU+xoxmGzg=="}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:23.702331 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-b9538121-4a18-46a6-9b4e-6f108f21fb50 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Getting quotas for project 6f64ad44d3c247caa7d106861916f245. Resources: {'key_pairs'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:53:23.708261 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-b9538121-4a18-46a6-9b4e-6f108f21fb50 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Getting quotas for user 034858240ac34e549aa5e0754726f9c6 and project 6f64ad44d3c247caa7d106861916f245. Resources: {'key_pairs'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:53:23.740789 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b9538121-4a18-46a6-9b4e-6f108f21fb50 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.060084 Jun 22 11:53:23.743961 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 413/773] 10.222.0.36 () {62 vars in 1199 bytes} [Wed Jun 22 11:53:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 11:53:23.876109 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c89866b0-fc8c-419c-aa9d-0fb23fdb0841 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'create', calling method: .version_select at 0x7f3ea831db80>, body: {"keypair": {"name": "tempest-keypair-1630001352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZKE6temRV0dc48A9fICz9vuBmORa+fchyNmzI57B3o+ZcgbWahIe6n+usHpJ82sPWCSgbpza/TfLxGvS++I0asBiUrLbhilYcaNNP4CVJLhSXMiohyLb2EgrY1QIPjqQ=="}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:23.906683 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-c89866b0-fc8c-419c-aa9d-0fb23fdb0841 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Getting quotas for project 878b71f291ec4107a09e3109b6acc40b. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:53:23.914929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-c89866b0-fc8c-419c-aa9d-0fb23fdb0841 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Getting quotas for user 4d7c1adbb2ad456eaf5793a15d6fcb4b and project 878b71f291ec4107a09e3109b6acc40b. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:53:23.947846 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c89866b0-fc8c-419c-aa9d-0fb23fdb0841 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [970ce608-669d-48f6-a8b8-91cef762f1ef] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 11:53:24.145063 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-004e64ed-c4d3-4515-a142-653c5e2cda0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:24.146420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-004e64ed-c4d3-4515-a142-653c5e2cda0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:24.154360 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-004e64ed-c4d3-4515-a142-653c5e2cda0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:24.154920 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-004e64ed-c4d3-4515-a142-653c5e2cda0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:24.156010 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-004e64ed-c4d3-4515-a142-653c5e2cda0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:24.156572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-004e64ed-c4d3-4515-a142-653c5e2cda0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:24.191585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-004e64ed-c4d3-4515-a142-653c5e2cda0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:53:24.303871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-004e64ed-c4d3-4515-a142-653c5e2cda0b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 204 len: 0 microversion: 2.1 time: 0.163612 Jun 22 11:53:24.304937 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 414/774] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:53:24 2022] DELETE /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 11:53:24.320178 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d65e8631-d109-49ca-b0dd-837e9205036a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:24.321165 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d65e8631-d109-49ca-b0dd-837e9205036a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:24.333114 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d65e8631-d109-49ca-b0dd-837e9205036a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:24.333630 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d65e8631-d109-49ca-b0dd-837e9205036a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:24.334570 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d65e8631-d109-49ca-b0dd-837e9205036a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:24.347914 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d65e8631-d109-49ca-b0dd-837e9205036a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:24.487936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d65e8631-d109-49ca-b0dd-837e9205036a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:24.496420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d65e8631-d109-49ca-b0dd-837e9205036a tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1508 microversion: 2.1 time: 0.187035 Jun 22 11:53:24.497019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 415/775] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:24 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:24.506953 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-242fdb5b-8002-44e8-8241-3e3936ef0a8e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:24.506953 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-242fdb5b-8002-44e8-8241-3e3936ef0a8e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:24.510016 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-242fdb5b-8002-44e8-8241-3e3936ef0a8e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:24.510459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-242fdb5b-8002-44e8-8241-3e3936ef0a8e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:24.511291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-242fdb5b-8002-44e8-8241-3e3936ef0a8e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:24.511815 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-242fdb5b-8002-44e8-8241-3e3936ef0a8e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:24.546647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-242fdb5b-8002-44e8-8241-3e3936ef0a8e tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048517 Jun 22 11:53:24.547295 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 416/776] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:53:24 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:24.955315 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [None req-c89866b0-fc8c-419c-aa9d-0fb23fdb0841 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [970ce608-669d-48f6-a8b8-91cef762f1ef] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49940. Jun 22 11:53:24.969664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c89866b0-fc8c-419c-aa9d-0fb23fdb0841 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.097440 Jun 22 11:53:24.970359 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 361/777] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 11:53:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:25.518342 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a8786c1c-31c6-44f8-bb6e-12aa6e4de88b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:25.519653 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a8786c1c-31c6-44f8-bb6e-12aa6e4de88b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:25.529626 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a8786c1c-31c6-44f8-bb6e-12aa6e4de88b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:25.530334 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a8786c1c-31c6-44f8-bb6e-12aa6e4de88b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:25.531272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a8786c1c-31c6-44f8-bb6e-12aa6e4de88b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:25.531739 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a8786c1c-31c6-44f8-bb6e-12aa6e4de88b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:25.559390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-25464897-13ec-44e0-92b7-16cd44072d4f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:25.560320 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-25464897-13ec-44e0-92b7-16cd44072d4f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:25.575332 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25464897-13ec-44e0-92b7-16cd44072d4f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:25.575985 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25464897-13ec-44e0-92b7-16cd44072d4f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:25.576891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25464897-13ec-44e0-92b7-16cd44072d4f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:25.577527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25464897-13ec-44e0-92b7-16cd44072d4f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:25.613683 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-25464897-13ec-44e0-92b7-16cd44072d4f tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056791 Jun 22 11:53:25.615083 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 362/778] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:53:25 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 11:53:25.630506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:25.630506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:25.631290 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:25.631964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:25.633601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:25.634037 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:25.729963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] HTTP exception thrown: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 is not attached to volume a10f720e-28d8-4a27-8dae-e0c775252572 Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Request method failure captured: Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments/a10f720e-28d8-4a27-8dae-e0c775252572 HTTP/1.1 Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswFoYCIRN6Epx3d6stm7zqIM9rvIpNeTZZHulOSfoAC3C3oO3vfzje23XRYc8VamZC3p7UERORgylMnq2v6ratJ0b73_FYnHBvyxb7Z0VhV519lBKNUWJJnHJyuMf1aj70G8w3_M0rWt1RBOJyxFSR76OhNCLvyo44FqmjgAPvVJvM8 Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 2975e2c648284a80824126eecc5d0269 Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-TestMinimumBasicScenario-240133324 Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:53:25.732533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2975e2c648284a80824126eecc5d0269"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2975e2c648284a80824126eecc5d0269"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2975e2c648284a80824126eecc5d0269", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2975e2c648284a80824126eecc5d0269"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-TestMinimumBasicScenario-240133324 Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 2975e2c648284a80824126eecc5d0269 Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-TestMinimumBasicScenario-240133324 Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-TestMinimumBasicScenario-240133324-project Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 8fc6cd29af4d4c28bec9bf6cc9db5749 Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-TestMinimumBasicScenario-240133324-project Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:53:25.733895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 is not attached to volume a10f720e-28d8-4a27-8dae-e0c775252572 Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'server_id': '5d3e9cd1-e3da-436f-a4e7-f6c953c83df4', 'id': 'a10f720e-28d8-4a27-8dae-e0c775252572'} Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a10f720e-28d8-4a27-8dae-e0c775252572. Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:53:25.734610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 is not attached to volume a10f720e-28d8-4a27-8dae-e0c775252572 Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 is not attached to volume a10f720e-28d8-4a27-8dae-e0c775252572 Jun 22 11:53:25.735824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:25.738437 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Returning 404 to user: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 is not attached to volume a10f720e-28d8-4a27-8dae-e0c775252572 {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:53:25.739575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-17ac3779-7774-4389-9090-134940ff05fb tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments/a10f720e-28d8-4a27-8dae-e0c775252572" status: 404 len: 154 microversion: 2.1 time: 0.119016 Jun 22 11:53:25.740310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 363/779] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 11:53:25 2022] DELETE /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4/os-volume_attachments/a10f720e-28d8-4a27-8dae-e0c775252572 => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 11:53:25.757073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a8786c1c-31c6-44f8-bb6e-12aa6e4de88b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:25.764103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-382083985", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "013daf2a-4a2c-4d6d-87db-478221667b1b"}], "security_groups": [{"name": "tempest-securitygroup--14669121"}], "key_name": "tempest-keypair-1189441356", "user_data": "}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:25.770248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a8786c1c-31c6-44f8-bb6e-12aa6e4de88b tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 200 len: 1508 microversion: 2.1 time: 0.259526 Jun 22 11:53:25.771038 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 417/780] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:25 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:25.922629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-ec0c5bfe-c643-4912-9af1-dd3718efd722 req-a8c13721-4c70-4ee1-82be-bcf893aca548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1581a659-3e36-43de-ac70-26d15c41f86e", "name": "network-vif-deleted", "tag": "cf6ccaa0-4359-4273-b639-c746e0759b41"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:25.934521 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-ec0c5bfe-c643-4912-9af1-dd3718efd722 req-a8c13721-4c70-4ee1-82be-bcf893aca548 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:25.949020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-ec0c5bfe-c643-4912-9af1-dd3718efd722 req-a8c13721-4c70-4ee1-82be-bcf893aca548 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:25.965615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-ec0c5bfe-c643-4912-9af1-dd3718efd722 req-a8c13721-4c70-4ee1-82be-bcf893aca548 service nova] Creating event network-vif-deleted:cf6ccaa0-4359-4273-b639-c746e0759b41 for instance 1581a659-3e36-43de-ac70-26d15c41f86e on hv-cinder-83697 Jun 22 11:53:25.971286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-ec0c5bfe-c643-4912-9af1-dd3718efd722 req-a8c13721-4c70-4ee1-82be-bcf893aca548 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056609 Jun 22 11:53:25.972308 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 418/781] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:53:26.036587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] validate_networks() for [('013daf2a-4a2c-4d6d-87db-478221667b1b', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:53:26.650439 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1107119521", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d91d34e-dd0f-40af-839d-b9e28bcb41b2"}], "security_groups": [{"name": "tempest-securitygroup--710513778"}], "key_name": "tempest-keypair-1630001352", "user_data": "}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:26.663438 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:53:26.663922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:53:26.664460 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:53:26.664925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:53:26.665392 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:53:26.674858 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:26.675397 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:26.676286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:26.676777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:26.693967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Getting quotas for project 6f64ad44d3c247caa7d106861916f245. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:53:26.697904 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Getting quotas for user 034858240ac34e549aa5e0754726f9c6 and project 6f64ad44d3c247caa7d106861916f245. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:53:26.709796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:53:26.712164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:53:26.754941 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] validate_networks() for [('2d91d34e-dd0f-40af-839d-b9e28bcb41b2', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:53:26.757836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-42fe0dfe-8080-431e-a48b-e73e575b4c19 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.005208 Jun 22 11:53:26.758654 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 364/782] 10.222.0.36 () {62 vars in 1187 bytes} [Wed Jun 22 11:53:25 2022] POST /compute/v2.1/servers => generated 400 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 11:53:26.769409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-938389ab-700d-45cf-81d9-3112915984d8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:26.770005 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-938389ab-700d-45cf-81d9-3112915984d8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:26.828628 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-938389ab-700d-45cf-81d9-3112915984d8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:26.836664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-938389ab-700d-45cf-81d9-3112915984d8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:26.838145 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-938389ab-700d-45cf-81d9-3112915984d8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:26.839264 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-938389ab-700d-45cf-81d9-3112915984d8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1281 microversion: 2.20 time: 0.074296 Jun 22 11:53:26.839911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 365/783] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:26 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:53:26.844281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:26.844872 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: 1581a659-3e36-43de-ac70-26d15c41f86e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:26.851647 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:26.852087 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:26.852878 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:26.853304 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:26.867542 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] HTTP exception thrown: Instance 1581a659-3e36-43de-ac70-26d15c41f86e could not be found. Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Request method failure captured: Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e HTTP/1.1 Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswDQxWzIxo8L5QrqUkiWxFb74S_4r3NBQOJ4hKUuQsgRXMFyN-xWyQGiIP0dyUdqvS5aykt2GDDGJWzhMBWy1CiaPbE9Ss9zKyf_rUf2kDN7EST2rbUklHXeBv05p1XtQ6cRoUK9eZw2b2e4Lejk_iT-ELbafxVWciapxpL1eJB2NUo Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:53:26.869070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20536d2fa444e97b7184c10e52d5cc5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 27cc3d38926f470c91eeb6aecfc86a48 Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 1581a659-3e36-43de-ac70-26d15c41f86e could not be found. Jun 22 11:53:26.870656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '1581a659-3e36-43de-ac70-26d15c41f86e'} Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1581a659-3e36-43de-ac70-26d15c41f86e could not be found. Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:53:26.871525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1581a659-3e36-43de-ac70-26d15c41f86e could not be found. Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1581a659-3e36-43de-ac70-26d15c41f86e could not be found. Jun 22 11:53:26.872727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:53:26.873816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Returning 404 to user: Instance 1581a659-3e36-43de-ac70-26d15c41f86e could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:53:26.873816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e099035f-1285-41aa-92ec-9afa4975c8dc tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e" status: 404 len: 111 microversion: 2.1 time: 0.029618 Jun 22 11:53:26.873816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 366/784] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:26 2022] GET /compute/v2.1/servers/1581a659-3e36-43de-ac70-26d15c41f86e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:53:26.878680 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0be2890f-8960-49a8-a193-868a604f4b97 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:26.879166 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0be2890f-8960-49a8-a193-868a604f4b97 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:26.885211 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0be2890f-8960-49a8-a193-868a604f4b97 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:26.885649 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0be2890f-8960-49a8-a193-868a604f4b97 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:26.886395 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0be2890f-8960-49a8-a193-868a604f4b97 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:26.886816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0be2890f-8960-49a8-a193-868a604f4b97 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:26.913214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0be2890f-8960-49a8-a193-868a604f4b97 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:53:26.973881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:27.001041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0be2890f-8960-49a8-a193-868a604f4b97 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 204 len: 0 microversion: 2.1 time: 0.125035 Jun 22 11:53:27.001624 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 367/785] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:53:26 2022] DELETE /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 11:53:27.007776 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-613371f0-d605-4175-b380-0927cdf36ee7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:27.008353 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-613371f0-d605-4175-b380-0927cdf36ee7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:27.011311 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:27.015442 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-613371f0-d605-4175-b380-0927cdf36ee7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:27.016035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-613371f0-d605-4175-b380-0927cdf36ee7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:27.016808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-613371f0-d605-4175-b380-0927cdf36ee7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:27.017239 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-613371f0-d605-4175-b380-0927cdf36ee7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:27.046127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-613371f0-d605-4175-b380-0927cdf36ee7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:53:27.122125 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-613371f0-d605-4175-b380-0927cdf36ee7 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 204 len: 0 microversion: 2.1 time: 0.118118 Jun 22 11:53:27.122934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 368/786] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:53:27 2022] DELETE /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:53:27.129022 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-31943195-f5c1-4f5e-8bd8-10512c1ebc7f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:27.129780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-31943195-f5c1-4f5e-8bd8-10512c1ebc7f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:27.135986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-31943195-f5c1-4f5e-8bd8-10512c1ebc7f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:27.136422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-31943195-f5c1-4f5e-8bd8-10512c1ebc7f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:27.137172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-31943195-f5c1-4f5e-8bd8-10512c1ebc7f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:27.137635 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-31943195-f5c1-4f5e-8bd8-10512c1ebc7f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:27.263738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:53:27.264156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:53:27.264629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:53:27.265038 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:53:27.265446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:53:27.275216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:27.275700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:27.276517 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:27.276945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:27.294500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Getting quotas for project 878b71f291ec4107a09e3109b6acc40b. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:53:27.298412 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Getting quotas for user 4d7c1adbb2ad456eaf5793a15d6fcb4b and project 878b71f291ec4107a09e3109b6acc40b. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:53:27.310644 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:53:27.313553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:53:27.313720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-31943195-f5c1-4f5e-8bd8-10512c1ebc7f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:27.321363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-31943195-f5c1-4f5e-8bd8-10512c1ebc7f tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.197566 Jun 22 11:53:27.321920 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 369/787] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:27 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:27.326409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-706b1f0f-e9b7-4680-8cca-08be3ef9a2fd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:27.327006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-706b1f0f-e9b7-4680-8cca-08be3ef9a2fd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:27.333547 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-706b1f0f-e9b7-4680-8cca-08be3ef9a2fd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:27.334307 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-706b1f0f-e9b7-4680-8cca-08be3ef9a2fd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:27.335175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-706b1f0f-e9b7-4680-8cca-08be3ef9a2fd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:27.335636 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-706b1f0f-e9b7-4680-8cca-08be3ef9a2fd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:27.358909 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [8d72f8c2-dd5f-4743-9736-a49c2ced87b8] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 11:53:27.461380 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-706b1f0f-e9b7-4680-8cca-08be3ef9a2fd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:27.468863 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-706b1f0f-e9b7-4680-8cca-08be3ef9a2fd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1555 microversion: 2.1 time: 0.146015 Jun 22 11:53:27.469427 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 370/788] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:27 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:27.858394 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-52a6f668-e32d-4085-8a5d-f60b1ee7bf54 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:27.859003 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-52a6f668-e32d-4085-8a5d-f60b1ee7bf54 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:27.910853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-52a6f668-e32d-4085-8a5d-f60b1ee7bf54 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:27.917981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-52a6f668-e32d-4085-8a5d-f60b1ee7bf54 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:27.919553 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-52a6f668-e32d-4085-8a5d-f60b1ee7bf54 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:27.920663 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-52a6f668-e32d-4085-8a5d-f60b1ee7bf54 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1281 microversion: 2.20 time: 0.066485 Jun 22 11:53:27.921214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 371/789] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:27 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:53:28.339674 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ca4258ea-aab7-46a9-affa-b7142eca0ea9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:28.340349 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ca4258ea-aab7-46a9-affa-b7142eca0ea9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:28.347654 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca4258ea-aab7-46a9-affa-b7142eca0ea9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:28.348100 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca4258ea-aab7-46a9-affa-b7142eca0ea9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:28.348852 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca4258ea-aab7-46a9-affa-b7142eca0ea9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:28.349281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ca4258ea-aab7-46a9-affa-b7142eca0ea9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:28.366351 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [8d72f8c2-dd5f-4743-9736-a49c2ced87b8] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 50018. Jun 22 11:53:28.370557 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b5238789-07a6-4adb-9623-a192efa377aa tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.724906 Jun 22 11:53:28.371639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 419/790] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:53:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 11:53:28.381071 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-311ccba1-7f4d-40cb-b4f6-7ba3def70a83 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:28.382019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-311ccba1-7f4d-40cb-b4f6-7ba3def70a83 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:28.450795 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-311ccba1-7f4d-40cb-b4f6-7ba3def70a83 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:28.458686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-311ccba1-7f4d-40cb-b4f6-7ba3def70a83 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1238 microversion: 2.1 time: 0.080990 Jun 22 11:53:28.464435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 420/791] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:28 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:53:28.486073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-aa09cb3d-13c4-446e-b16f-5a769642e1b9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:28.486722 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-aa09cb3d-13c4-446e-b16f-5a769642e1b9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:28.494988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa09cb3d-13c4-446e-b16f-5a769642e1b9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:28.495955 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa09cb3d-13c4-446e-b16f-5a769642e1b9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:28.497153 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa09cb3d-13c4-446e-b16f-5a769642e1b9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:28.497545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa09cb3d-13c4-446e-b16f-5a769642e1b9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:28.515406 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ca4258ea-aab7-46a9-affa-b7142eca0ea9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:28.525690 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ca4258ea-aab7-46a9-affa-b7142eca0ea9 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.189836 Jun 22 11:53:28.526265 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 372/792] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:28 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:53:28.640314 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aa09cb3d-13c4-446e-b16f-5a769642e1b9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:28.655464 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-aa09cb3d-13c4-446e-b16f-5a769642e1b9 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1555 microversion: 2.1 time: 0.172861 Jun 22 11:53:28.656603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 421/793] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:28 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:53:28.938167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-66be1b30-30d2-45e5-a76f-f2bd63a44070 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:28.939043 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-66be1b30-30d2-45e5-a76f-f2bd63a44070 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:28.995723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-66be1b30-30d2-45e5-a76f-f2bd63a44070 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:29.003534 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-66be1b30-30d2-45e5-a76f-f2bd63a44070 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:29.005050 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-66be1b30-30d2-45e5-a76f-f2bd63a44070 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:29.006133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-66be1b30-30d2-45e5-a76f-f2bd63a44070 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1281 microversion: 2.20 time: 0.071872 Jun 22 11:53:29.006683 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 373/794] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:28 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:29.475917 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-84078f96-f662-4f94-ba18-2816887486c2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:29.476525 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-84078f96-f662-4f94-ba18-2816887486c2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:29.482691 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-84078f96-f662-4f94-ba18-2816887486c2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:29.483402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-84078f96-f662-4f94-ba18-2816887486c2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:29.484364 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-84078f96-f662-4f94-ba18-2816887486c2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:29.484802 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-84078f96-f662-4f94-ba18-2816887486c2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:29.542209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2ca344c6-9b01-4c26-9341-64d8196746eb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:29.542818 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2ca344c6-9b01-4c26-9341-64d8196746eb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:29.550415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2ca344c6-9b01-4c26-9341-64d8196746eb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:29.551147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2ca344c6-9b01-4c26-9341-64d8196746eb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:29.552012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2ca344c6-9b01-4c26-9341-64d8196746eb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:29.552610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2ca344c6-9b01-4c26-9341-64d8196746eb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:29.553497 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-84078f96-f662-4f94-ba18-2816887486c2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:29.561756 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-84078f96-f662-4f94-ba18-2816887486c2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1234 microversion: 2.1 time: 0.089079 Jun 22 11:53:29.562786 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 422/795] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:29 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:29.674463 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2f0a722d-f1b2-482e-a0ec-eccd937f2e96 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:29.675080 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2f0a722d-f1b2-482e-a0ec-eccd937f2e96 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:29.681440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2f0a722d-f1b2-482e-a0ec-eccd937f2e96 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:29.682147 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2f0a722d-f1b2-482e-a0ec-eccd937f2e96 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:29.682925 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2f0a722d-f1b2-482e-a0ec-eccd937f2e96 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:29.683385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2f0a722d-f1b2-482e-a0ec-eccd937f2e96 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:29.687890 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:29.697064 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2ca344c6-9b01-4c26-9341-64d8196746eb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:29.706032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2ca344c6-9b01-4c26-9341-64d8196746eb tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1522 microversion: 2.1 time: 0.167660 Jun 22 11:53:29.707056 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 374/796] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:29 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:29.823213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2f0a722d-f1b2-482e-a0ec-eccd937f2e96 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:29.831132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2f0a722d-f1b2-482e-a0ec-eccd937f2e96 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1555 microversion: 2.1 time: 0.160973 Jun 22 11:53:29.831775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 423/797] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:29 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:53:30.024665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5a609ac1-144c-4f4b-9b79-34551eee1722 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:30.025569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5a609ac1-144c-4f4b-9b79-34551eee1722 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:30.113133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5a609ac1-144c-4f4b-9b79-34551eee1722 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:30.135637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5a609ac1-144c-4f4b-9b79-34551eee1722 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:30.138848 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5a609ac1-144c-4f4b-9b79-34551eee1722 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:30.144103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5a609ac1-144c-4f4b-9b79-34551eee1722 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1281 microversion: 2.20 time: 0.122548 Jun 22 11:53:30.146941 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 375/798] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:30 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:30.349699 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-a28c929f-9ec3-432b-9802-91d86a2a1e44 req-5dfe5884-b70e-4aeb-aa62-b1ed9fbc0103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3c3cce-4dbe-44a3-b2df-7e43078812f8", "name": "network-vif-deleted", "tag": "2a25c2c3-035b-4263-bc42-63433b20fb62"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:30.364392 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-a28c929f-9ec3-432b-9802-91d86a2a1e44 req-5dfe5884-b70e-4aeb-aa62-b1ed9fbc0103 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.365119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-a28c929f-9ec3-432b-9802-91d86a2a1e44 req-5dfe5884-b70e-4aeb-aa62-b1ed9fbc0103 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.379400 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-a28c929f-9ec3-432b-9802-91d86a2a1e44 req-5dfe5884-b70e-4aeb-aa62-b1ed9fbc0103 service nova] Creating event network-vif-deleted:2a25c2c3-035b-4263-bc42-63433b20fb62 for instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 on hv-cinder-83697 Jun 22 11:53:30.387765 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-a28c929f-9ec3-432b-9802-91d86a2a1e44 req-5dfe5884-b70e-4aeb-aa62-b1ed9fbc0103 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044596 Jun 22 11:53:30.389028 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 424/799] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:30.582119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8ecb6197-d9dd-49b2-9b75-e37a748eff88 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:30.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8ecb6197-d9dd-49b2-9b75-e37a748eff88 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:30.589611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8ecb6197-d9dd-49b2-9b75-e37a748eff88 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.590200 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8ecb6197-d9dd-49b2-9b75-e37a748eff88 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.591201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8ecb6197-d9dd-49b2-9b75-e37a748eff88 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.591903 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8ecb6197-d9dd-49b2-9b75-e37a748eff88 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.671262 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8ecb6197-d9dd-49b2-9b75-e37a748eff88 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:30.680274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8ecb6197-d9dd-49b2-9b75-e37a748eff88 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1296 microversion: 2.1 time: 0.104141 Jun 22 11:53:30.680924 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 376/800] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:30 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:30.724345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:30.725052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:30.736142 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.736587 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.737364 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.737821 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.773536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.773978 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.774542 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lazy-loading 'fault' on Instance uuid bf3c3cce-4dbe-44a3-b2df-7e43078812f8 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:53:30.825818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cc3d38926f470c91eeb6aecfc86a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20536d2fa444e97b7184c10e52d5cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:30.836112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ba8b6be5-0589-4019-85ef-c81e1fa96f33 tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 200 len: 1311 microversion: 2.1 time: 0.116334 Jun 22 11:53:30.836896 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 425/801] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:30 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 1311 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:30.848495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:30.849191 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:30.855216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.855691 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.856472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.856895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.861089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:30.893523 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:30.894126 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:30.894665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lazy-loading 'fault' on Instance uuid 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:53:30.949058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc6cd29af4d4c28bec9bf6cc9db5749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2975e2c648284a80824126eecc5d0269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:30.956988 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-84906db7-a255-40f9-a7b0-689b02d59366 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 200 len: 1349 microversion: 2.1 time: 0.112340 Jun 22 11:53:30.957569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 377/802] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:30 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 1349 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:53:31.169906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:31.170532 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:31.191592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.193441 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:31.195256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.200181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:31.305906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:31.314991 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:31.316827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:31.318073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-19dfeae5-9055-4b29-bc69-a3e88fc81792 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1285 microversion: 2.20 time: 0.157485 Jun 22 11:53:31.318738 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 426/803] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:31 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:31.698027 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-49e68942-6108-4606-a2f3-d8707db9634e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:31.698926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-49e68942-6108-4606-a2f3-d8707db9634e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:31.706533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-49e68942-6108-4606-a2f3-d8707db9634e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.707710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-49e68942-6108-4606-a2f3-d8707db9634e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:31.709287 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-49e68942-6108-4606-a2f3-d8707db9634e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.709816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-49e68942-6108-4606-a2f3-d8707db9634e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:31.722853 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-52d84cec-4bf5-4bbb-bbde-aa487c544f4c req-cdc2dbda-b708-4eab-87b2-b6fe8dfc363b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c949fdfd-21bc-4762-9e00-db7937f32e69", "tag": "162c3a1d-7840-4496-a4db-751b8245d273"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:31.733142 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-52d84cec-4bf5-4bbb-bbde-aa487c544f4c req-cdc2dbda-b708-4eab-87b2-b6fe8dfc363b service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.733691 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-52d84cec-4bf5-4bbb-bbde-aa487c544f4c req-cdc2dbda-b708-4eab-87b2-b6fe8dfc363b service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:31.752138 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-52d84cec-4bf5-4bbb-bbde-aa487c544f4c req-cdc2dbda-b708-4eab-87b2-b6fe8dfc363b service nova] Creating event network-changed:162c3a1d-7840-4496-a4db-751b8245d273 for instance c949fdfd-21bc-4762-9e00-db7937f32e69 on hv-cinder-83697 Jun 22 11:53:31.756838 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-52d84cec-4bf5-4bbb-bbde-aa487c544f4c req-cdc2dbda-b708-4eab-87b2-b6fe8dfc363b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037590 Jun 22 11:53:31.758025 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 427/804] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:31.855154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:31.855932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] [instance: bf3c3cce-4dbe-44a3-b2df-7e43078812f8] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:31.863529 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.864249 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:31.865207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.865643 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:31.881403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-49e68942-6108-4606-a2f3-d8707db9634e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:31.881723 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] HTTP exception thrown: Instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 could not be found. Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Request method failure captured: Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 HTTP/1.1 Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDQxWzIxo8L5QrqUkiWxFb74S_4r3NBQOJ4hKUuQsgRXMFyN-xWyQGiIP0dyUdqvS5aykt2GDDGJWzhMBWy1CiaPbE9Ss9zKyf_rUf2kDN7EST2rbUklHXeBv05p1XtQ6cRoUK9eZw2b2e4Lejk_iT-ELbafxVWciapxpL1eJB2NUo Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:53:31.886709 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20536d2fa444e97b7184c10e52d5cc5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20536d2fa444e97b7184c10e52d5cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: d20536d2fa444e97b7184c10e52d5cc5 Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196465138 Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 27cc3d38926f470c91eeb6aecfc86a48 Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196465138-project Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 could not be found. Jun 22 11:53:31.889291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'bf3c3cce-4dbe-44a3-b2df-7e43078812f8'} Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 could not be found. Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:53:31.890519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 could not be found. Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 could not be found. Jun 22 11:53:31.893090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:31.895627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] Returning 404 to user: Instance bf3c3cce-4dbe-44a3-b2df-7e43078812f8 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:53:31.895627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6061a64c-719a-4f82-8b21-0522a02aad5e tempest-ServerRescueNegativeTestJSON-196465138 tempest-ServerRescueNegativeTestJSON-196465138-project] 10.222.0.36 "GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8" status: 404 len: 111 microversion: 2.1 time: 0.038624 Jun 22 11:53:31.895627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 428/805] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:31 2022] GET /compute/v2.1/servers/bf3c3cce-4dbe-44a3-b2df-7e43078812f8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 11:53:31.896067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-49e68942-6108-4606-a2f3-d8707db9634e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.198448 Jun 22 11:53:31.896067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 378/806] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:31 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:31.973876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:31.974481 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] [instance: 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:31.989297 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.990061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:31.991050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:31.991774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:32.025698 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] HTTP exception thrown: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 could not be found. Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Request method failure captured: Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 HTTP/1.1 Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswFoYCIRN6Epx3d6stm7zqIM9rvIpNeTZZHulOSfoAC3C3oO3vfzje23XRYc8VamZC3p7UERORgylMnq2v6ratJ0b73_FYnHBvyxb7Z0VhV519lBKNUWJJnHJyuMf1aj70G8w3_M0rWt1RBOJyxFSR76OhNCLvyo44FqmjgAPvVJvM8 Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 2975e2c648284a80824126eecc5d0269 Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-TestMinimumBasicScenario-240133324 Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:53:32.027253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2975e2c648284a80824126eecc5d0269"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2975e2c648284a80824126eecc5d0269"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2975e2c648284a80824126eecc5d0269", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2975e2c648284a80824126eecc5d0269"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-TestMinimumBasicScenario-240133324 Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 2975e2c648284a80824126eecc5d0269 Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-TestMinimumBasicScenario-240133324 Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-TestMinimumBasicScenario-240133324-project Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 8fc6cd29af4d4c28bec9bf6cc9db5749 Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-TestMinimumBasicScenario-240133324-project Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 could not be found. Jun 22 11:53:32.028869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '5d3e9cd1-e3da-436f-a4e7-f6c953c83df4'} Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 could not be found. Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:53:32.029743 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 could not be found. Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 could not be found. Jun 22 11:53:32.031234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:53:32.032606 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Returning 404 to user: Instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:53:32.032606 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b8236f28-37c5-47e9-b4a7-8ecc7d52a6dd tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4" status: 404 len: 111 microversion: 2.1 time: 0.061119 Jun 22 11:53:32.035710 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 429/807] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:31 2022] GET /compute/v2.1/servers/5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:53:32.043471 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e189b608-49de-49d9-960b-34901b782da5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] Calling method '.version_select at 0x7f3ea81f8160>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:32.073604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e189b608-49de-49d9-960b-34901b782da5 tempest-TestMinimumBasicScenario-240133324 tempest-TestMinimumBasicScenario-240133324-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1624224970" status: 202 len: 0 microversion: 2.1 time: 0.035525 Jun 22 11:53:32.077720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 379/808] 10.222.0.36 () {58 vars in 1271 bytes} [Wed Jun 22 11:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1624224970 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:53:32.338412 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:32.340077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:32.348584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:32.349274 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:32.350287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:32.350878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:32.412402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-9ea2c995-e11d-4339-86ae-44fbfb21b7cc req-91939c46-fa1c-481a-a9f8-399862731135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3e9cd1-e3da-436f-a4e7-f6c953c83df4", "name": "network-vif-deleted", "tag": "a4726067-df3c-4a9b-939a-61e6fd9345db"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:32.421172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-9ea2c995-e11d-4339-86ae-44fbfb21b7cc req-91939c46-fa1c-481a-a9f8-399862731135 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:32.421699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-9ea2c995-e11d-4339-86ae-44fbfb21b7cc req-91939c46-fa1c-481a-a9f8-399862731135 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:32.437061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-9ea2c995-e11d-4339-86ae-44fbfb21b7cc req-91939c46-fa1c-481a-a9f8-399862731135 service nova] Creating event network-vif-deleted:a4726067-df3c-4a9b-939a-61e6fd9345db for instance 5d3e9cd1-e3da-436f-a4e7-f6c953c83df4 on hv-cinder-83697 Jun 22 11:53:32.444552 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-9ea2c995-e11d-4339-86ae-44fbfb21b7cc req-91939c46-fa1c-481a-a9f8-399862731135 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036487 Jun 22 11:53:32.445918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 380/809] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:53:32.527599 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:32.542562 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:32.544838 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:32.546490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9873fdc1-4b5c-46be-8c92-7c39fb1a9596 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1339 microversion: 2.20 time: 0.213326 Jun 22 11:53:32.549568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 430/810] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:32 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1339 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:32.913993 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2d466074-3af2-439c-8638-85cade6d6014 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:32.914802 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2d466074-3af2-439c-8638-85cade6d6014 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:32.922717 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d466074-3af2-439c-8638-85cade6d6014 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:32.923756 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d466074-3af2-439c-8638-85cade6d6014 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:32.924783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d466074-3af2-439c-8638-85cade6d6014 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:32.925496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d466074-3af2-439c-8638-85cade6d6014 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:33.350756 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2d466074-3af2-439c-8638-85cade6d6014 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:33.358272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2d466074-3af2-439c-8638-85cade6d6014 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.450601 Jun 22 11:53:33.359068 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 381/811] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:32 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:33.569878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:33.571377 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:33.580440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:33.581072 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:33.582162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:33.582917 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:34.027052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:34.036361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:34.038632 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:34.040095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-88362d18-deb3-4526-8506-99ec6f81eea6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.476539 Jun 22 11:53:34.053518 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 431/812] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:33 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:34.377673 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b8534092-ecd0-4e75-b336-8f4826dbcd1f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:34.378625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b8534092-ecd0-4e75-b336-8f4826dbcd1f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:34.389850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8534092-ecd0-4e75-b336-8f4826dbcd1f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:34.390547 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8534092-ecd0-4e75-b336-8f4826dbcd1f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:34.391702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8534092-ecd0-4e75-b336-8f4826dbcd1f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:34.392144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8534092-ecd0-4e75-b336-8f4826dbcd1f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:34.460216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-9a8b4ce0-458a-4ffd-9a6f-260706bc239f req-de592b3c-7bba-48a2-b1cc-728746adc505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f26d8d-a0e4-4c9a-bf16-88ec416eba46", "tag": "8c843eaa-9d2f-4212-b0db-0d0350968b30"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:34.468289 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-9a8b4ce0-458a-4ffd-9a6f-260706bc239f req-de592b3c-7bba-48a2-b1cc-728746adc505 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:34.468798 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-9a8b4ce0-458a-4ffd-9a6f-260706bc239f req-de592b3c-7bba-48a2-b1cc-728746adc505 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:34.480407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-9a8b4ce0-458a-4ffd-9a6f-260706bc239f req-de592b3c-7bba-48a2-b1cc-728746adc505 service nova] Creating event network-changed:8c843eaa-9d2f-4212-b0db-0d0350968b30 for instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 on hv-cinder-83697 Jun 22 11:53:34.485567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-9a8b4ce0-458a-4ffd-9a6f-260706bc239f req-de592b3c-7bba-48a2-b1cc-728746adc505 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029053 Jun 22 11:53:34.487040 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 432/813] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:34.653006 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b8534092-ecd0-4e75-b336-8f4826dbcd1f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:34.660887 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b8534092-ecd0-4e75-b336-8f4826dbcd1f tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.287988 Jun 22 11:53:34.661454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 382/814] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:34 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:35.061476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:35.062165 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:35.068952 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:35.069634 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:35.070425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:35.070849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:35.325707 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:35.335976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:35.337472 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:35.338563 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-81b71936-607d-4ccd-b6e1-bbbcd4db10a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.281741 Jun 22 11:53:35.339585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 433/815] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:35 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:35.678199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-854863da-838d-45ac-8020-d37258c9965e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:35.679196 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-854863da-838d-45ac-8020-d37258c9965e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:35.686086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-854863da-838d-45ac-8020-d37258c9965e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:35.686631 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-854863da-838d-45ac-8020-d37258c9965e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:35.687509 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-854863da-838d-45ac-8020-d37258c9965e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:35.688009 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-854863da-838d-45ac-8020-d37258c9965e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:35.904478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-854863da-838d-45ac-8020-d37258c9965e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:35.915187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-854863da-838d-45ac-8020-d37258c9965e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.240403 Jun 22 11:53:35.916887 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 383/816] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:35 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:36.356886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:36.358876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:36.371463 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:36.373209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:36.374264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:36.374712 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:36.622132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:36.635073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:36.640965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:36.653597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bb7aac87-7741-408d-8f56-aa4c64243757 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.300328 Jun 22 11:53:36.666602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 434/817] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:36 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:36.933888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5d072ad1-5128-411a-9da5-a68f4fda2171 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:36.934491 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5d072ad1-5128-411a-9da5-a68f4fda2171 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:36.937155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:36.947219 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5d072ad1-5128-411a-9da5-a68f4fda2171 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:36.947878 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5d072ad1-5128-411a-9da5-a68f4fda2171 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:36.948728 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5d072ad1-5128-411a-9da5-a68f4fda2171 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:36.949163 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5d072ad1-5128-411a-9da5-a68f4fda2171 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:37.235087 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5d072ad1-5128-411a-9da5-a68f4fda2171 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:37.258104 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5d072ad1-5128-411a-9da5-a68f4fda2171 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.323616 Jun 22 11:53:37.259580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 384/818] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:36 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:37.677097 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:37.678258 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:37.684062 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:37.686110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:37.686730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:37.687695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:37.688368 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:37.922839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:37.943162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:37.944607 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:37.947905 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b4b0c4eb-2fb4-4d59-bec3-6764817a4450 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.277067 Jun 22 11:53:37.948991 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 435/819] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:37 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:38.275758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bb525309-3a25-4d1c-8788-a3a1ced89d4d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:38.276501 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bb525309-3a25-4d1c-8788-a3a1ced89d4d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:38.284909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bb525309-3a25-4d1c-8788-a3a1ced89d4d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:38.285715 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bb525309-3a25-4d1c-8788-a3a1ced89d4d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:38.286849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bb525309-3a25-4d1c-8788-a3a1ced89d4d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:38.287580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bb525309-3a25-4d1c-8788-a3a1ced89d4d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:38.757787 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bb525309-3a25-4d1c-8788-a3a1ced89d4d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:38.772802 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bb525309-3a25-4d1c-8788-a3a1ced89d4d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.501080 Jun 22 11:53:38.773455 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 385/820] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:38 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:38.966317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:38.966931 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:38.974311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=12 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:38.977058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:38.977888 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:38.979040 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:38.988634 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:39.291105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:39.300269 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:39.301820 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:39.303512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7ad0e079-31f5-415b-bf3b-94931f89bc14 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.341346 Jun 22 11:53:39.303982 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 436/821] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:38 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:53:39.789704 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-200b5ec0-f7a2-4087-a200-d46086c99233 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:39.790422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-200b5ec0-f7a2-4087-a200-d46086c99233 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:39.798374 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-200b5ec0-f7a2-4087-a200-d46086c99233 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:39.799940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-200b5ec0-f7a2-4087-a200-d46086c99233 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:39.803330 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-200b5ec0-f7a2-4087-a200-d46086c99233 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:39.805141 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-200b5ec0-f7a2-4087-a200-d46086c99233 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:40.078963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-200b5ec0-f7a2-4087-a200-d46086c99233 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:40.092044 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-200b5ec0-f7a2-4087-a200-d46086c99233 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.305737 Jun 22 11:53:40.094152 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 386/822] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:39 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:40.324977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:40.325611 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:40.333717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:40.334261 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:40.336067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:40.336690 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:40.342735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-fdf0204b-4b49-421b-b443-b58ee2f8a32d req-7afc0f79-f194-4b02-863f-50d1a0896a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c949fdfd-21bc-4762-9e00-db7937f32e69", "name": "network-vif-plugged", "status": "completed", "tag": "162c3a1d-7840-4496-a4db-751b8245d273"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:40.363433 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=18 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:40.369299 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-fdf0204b-4b49-421b-b443-b58ee2f8a32d req-7afc0f79-f194-4b02-863f-50d1a0896a03 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:40.371309 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-fdf0204b-4b49-421b-b443-b58ee2f8a32d req-7afc0f79-f194-4b02-863f-50d1a0896a03 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:40.404511 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-fdf0204b-4b49-421b-b443-b58ee2f8a32d req-7afc0f79-f194-4b02-863f-50d1a0896a03 service nova] Creating event network-vif-plugged:162c3a1d-7840-4496-a4db-751b8245d273 for instance c949fdfd-21bc-4762-9e00-db7937f32e69 on hv-cinder-83697 Jun 22 11:53:40.428599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-fdf0204b-4b49-421b-b443-b58ee2f8a32d req-7afc0f79-f194-4b02-863f-50d1a0896a03 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091200 Jun 22 11:53:40.432084 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 387/823] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:53:40.566340 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:40.582114 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:40.584934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:40.587321 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-36ad366d-3da3-4f59-b7eb-e700f80d6110 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.269666 Jun 22 11:53:40.601525 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 437/824] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:40 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:41.111703 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-15e9ec34-276d-4623-ba8c-48671bf2dbdd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:41.112410 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-15e9ec34-276d-4623-ba8c-48671bf2dbdd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:41.118878 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-15e9ec34-276d-4623-ba8c-48671bf2dbdd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:41.119629 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-15e9ec34-276d-4623-ba8c-48671bf2dbdd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:41.120458 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-15e9ec34-276d-4623-ba8c-48671bf2dbdd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:41.120956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-15e9ec34-276d-4623-ba8c-48671bf2dbdd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:41.267966 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-15e9ec34-276d-4623-ba8c-48671bf2dbdd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:41.276805 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-15e9ec34-276d-4623-ba8c-48671bf2dbdd tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.170224 Jun 22 11:53:41.277747 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 388/825] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:41 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:41.608103 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:41.609482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:41.616931 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:41.617421 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:41.618351 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:41.618947 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:41.829337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:41.840216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:41.842788 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:41.844451 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-15e08929-4669-4eb9-a4a3-51b88e1b80fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.242004 Jun 22 11:53:41.857880 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 438/826] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:41 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:42.293770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-19250d77-7f97-48bc-b2a4-62e1e45e57eb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:42.294458 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-19250d77-7f97-48bc-b2a4-62e1e45e57eb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:42.301576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-19250d77-7f97-48bc-b2a4-62e1e45e57eb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:42.302312 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-19250d77-7f97-48bc-b2a4-62e1e45e57eb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:42.303573 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-19250d77-7f97-48bc-b2a4-62e1e45e57eb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:42.304233 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-19250d77-7f97-48bc-b2a4-62e1e45e57eb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:42.452360 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-19250d77-7f97-48bc-b2a4-62e1e45e57eb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:42.460347 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-19250d77-7f97-48bc-b2a4-62e1e45e57eb tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1363 microversion: 2.1 time: 0.170604 Jun 22 11:53:42.461115 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 389/827] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:42 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:42.507382 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-3aa80884-1277-46b8-a607-f66590f45765 req-96e06f65-f60c-4045-95be-e9e6e6a60331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f26d8d-a0e4-4c9a-bf16-88ec416eba46", "name": "network-vif-plugged", "status": "completed", "tag": "8c843eaa-9d2f-4212-b0db-0d0350968b30"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:42.516426 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-3aa80884-1277-46b8-a607-f66590f45765 req-96e06f65-f60c-4045-95be-e9e6e6a60331 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:42.517507 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-3aa80884-1277-46b8-a607-f66590f45765 req-96e06f65-f60c-4045-95be-e9e6e6a60331 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:42.528875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-3aa80884-1277-46b8-a607-f66590f45765 req-96e06f65-f60c-4045-95be-e9e6e6a60331 service nova] Creating event network-vif-plugged:8c843eaa-9d2f-4212-b0db-0d0350968b30 for instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 on hv-cinder-83697 Jun 22 11:53:42.534549 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-3aa80884-1277-46b8-a607-f66590f45765 req-96e06f65-f60c-4045-95be-e9e6e6a60331 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030859 Jun 22 11:53:42.535154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 439/828] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:42.864183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:42.865044 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:42.875307 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:42.877854 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:42.879243 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:42.880148 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:43.100788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:43.116452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:43.119202 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:43.120494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-adc19852-7b89-44b8-9518-2e66d4de5d64 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.262042 Jun 22 11:53:43.121453 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 390/829] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:42 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:43.477443 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e02b266a-00dd-4b44-a452-df9d65668f72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:43.478144 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e02b266a-00dd-4b44-a452-df9d65668f72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:43.484300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e02b266a-00dd-4b44-a452-df9d65668f72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:43.484750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e02b266a-00dd-4b44-a452-df9d65668f72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:43.485575 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e02b266a-00dd-4b44-a452-df9d65668f72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:43.486531 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e02b266a-00dd-4b44-a452-df9d65668f72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:43.627200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e02b266a-00dd-4b44-a452-df9d65668f72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:43.634808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e02b266a-00dd-4b44-a452-df9d65668f72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1549 microversion: 2.1 time: 0.161519 Jun 22 11:53:43.635310 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 440/830] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:53:43 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:53:43.651093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4cff81b6-0be4-4e52-baf6-68c0cacfdd72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:43.651605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4cff81b6-0be4-4e52-baf6-68c0cacfdd72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:43.658251 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4cff81b6-0be4-4e52-baf6-68c0cacfdd72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:43.658890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4cff81b6-0be4-4e52-baf6-68c0cacfdd72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:43.659687 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4cff81b6-0be4-4e52-baf6-68c0cacfdd72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:43.660112 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4cff81b6-0be4-4e52-baf6-68c0cacfdd72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:43.744932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4cff81b6-0be4-4e52-baf6-68c0cacfdd72 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097537 Jun 22 11:53:43.745921 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 391/831] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 11:53:43 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:44.144540 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:44.145875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:44.152403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:44.153086 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:44.153947 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:44.154454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:44.573976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:44.583728 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:44.585478 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:44.586751 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-aeb0b7e8-d283-4616-8d2d-fe2f02d9cacf tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.448200 Jun 22 11:53:44.587836 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 441/832] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:44 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:45.153712 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-f44632a4-7efc-4831-bb8c-e01ab8622198 req-de5de645-11f5-45d2-8c9e-4792cfbe9edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c949fdfd-21bc-4762-9e00-db7937f32e69", "tag": "162c3a1d-7840-4496-a4db-751b8245d273"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:45.162523 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-f44632a4-7efc-4831-bb8c-e01ab8622198 req-de5de645-11f5-45d2-8c9e-4792cfbe9edd service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:45.162881 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-f44632a4-7efc-4831-bb8c-e01ab8622198 req-de5de645-11f5-45d2-8c9e-4792cfbe9edd service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:45.174998 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-f44632a4-7efc-4831-bb8c-e01ab8622198 req-de5de645-11f5-45d2-8c9e-4792cfbe9edd service nova] Creating event network-changed:162c3a1d-7840-4496-a4db-751b8245d273 for instance c949fdfd-21bc-4762-9e00-db7937f32e69 on hv-cinder-83697 Jun 22 11:53:45.180105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-f44632a4-7efc-4831-bb8c-e01ab8622198 req-de5de645-11f5-45d2-8c9e-4792cfbe9edd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030793 Jun 22 11:53:45.180697 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 392/833] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:45.605629 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:45.606422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:45.613201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:45.617358 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:45.618512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:45.619610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:45.809591 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:45.819534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:45.821377 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:45.822699 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3ae9f1c2-f185-483b-bb82-ac9db5e4f90b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1405 microversion: 2.20 time: 0.221007 Jun 22 11:53:45.823659 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 442/834] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:45 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:46.847093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:46.851931 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:46.859572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:46.860975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:46.862802 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:46.864170 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:47.187202 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:47.198744 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:47.200677 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:53:47.201944 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c0739d0c-a834-42f6-bc55-025e5a5385e0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1597 microversion: 2.20 time: 0.363485 Jun 22 11:53:47.202519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 393/835] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:53:46 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1597 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:53:47.220440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-11cb9671-eed9-42d4-9f0a-064bfa946b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:53:47.221015 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-11cb9671-eed9-42d4-9f0a-064bfa946b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:53:47.228416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-11cb9671-eed9-42d4-9f0a-064bfa946b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:47.229141 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-11cb9671-eed9-42d4-9f0a-064bfa946b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:47.230135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-11cb9671-eed9-42d4-9f0a-064bfa946b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:47.230759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-11cb9671-eed9-42d4-9f0a-064bfa946b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:47.248832 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=100 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:53:47.370998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-11cb9671-eed9-42d4-9f0a-064bfa946b0c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.154059 Jun 22 11:53:47.371702 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 443/836] 10.222.0.36 () {60 vars in 1315 bytes} [Wed Jun 22 11:53:47 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:53:48.582108 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-f99c772a-889d-4f93-bbe3-d797f4c9eda4 req-05ebe04d-b1ab-4765-b892-7f0fe95d7e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f26d8d-a0e4-4c9a-bf16-88ec416eba46", "tag": "8c843eaa-9d2f-4212-b0db-0d0350968b30"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:48.591580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-f99c772a-889d-4f93-bbe3-d797f4c9eda4 req-05ebe04d-b1ab-4765-b892-7f0fe95d7e29 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:53:48.592393 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-f99c772a-889d-4f93-bbe3-d797f4c9eda4 req-05ebe04d-b1ab-4765-b892-7f0fe95d7e29 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:53:48.818507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-f99c772a-889d-4f93-bbe3-d797f4c9eda4 req-05ebe04d-b1ab-4765-b892-7f0fe95d7e29 service nova] Creating event network-changed:8c843eaa-9d2f-4212-b0db-0d0350968b30 for instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 on hv-cinder-83697 Jun 22 11:53:48.825432 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-f99c772a-889d-4f93-bbe3-d797f4c9eda4 req-05ebe04d-b1ab-4765-b892-7f0fe95d7e29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248211 Jun 22 11:53:48.826201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 394/837] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:53:55.126517 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-daa017e7-1e27-4664-9260-74bf9d1a6d66 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Action: 'create', calling method: .version_select at 0x7f3ea821c280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-979420716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjVrwJKziVkhph4UdoLy9DcP1RwkHhoNGiGbs/nOI4XYLDLagu+/oshBcJ9kgB9b1De04E9rjUEvlL5NaepkJhfXXtdg11VsCZGw1muHOdmE05zwNGI0aan4UI0TGsPuw=="}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:53:55.141827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-daa017e7-1e27-4664-9260-74bf9d1a6d66 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Getting quotas for project edbd324693e24bcdbf41c207d29d7e2e. Resources: {'key_pairs'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:53:55.145810 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-daa017e7-1e27-4664-9260-74bf9d1a6d66 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Getting quotas for user 239de565f79f474bb21699fd9adc96c4 and project edbd324693e24bcdbf41c207d29d7e2e. Resources: {'key_pairs'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:53:55.171430 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-daa017e7-1e27-4664-9260-74bf9d1a6d66 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.283667 Jun 22 11:53:55.172215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 444/838] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 11:53:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:54:26.428638 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:54:26.429370 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=84 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:54:26.433396 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-53989590", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-979420716", "security_groups": [{"name": "tempest-secgroup-smoke-884704384"}], "block_device_mapping_v2": [{"uuid": "7d37eb09-2952-460c-a578-fc5fabbbf0c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b232377-d4d3-4e90-9c76-2affccfcccc5"}]}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:54:26.548105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] validate_networks() for [('9b232377-d4d3-4e90-9c76-2affccfcccc5', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:54:26.934639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:54:26.935119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:54:26.935713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:54:26.936097 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:54:26.936500 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:54:26.948384 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:26.948832 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:26.949631 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:26.950059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:26.967796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Getting quotas for project edbd324693e24bcdbf41c207d29d7e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:54:26.971746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Getting quotas for user 239de565f79f474bb21699fd9adc96c4 and project edbd324693e24bcdbf41c207d29d7e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:54:27.030993 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:54:27.033215 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d37eb09-2952-460c-a578-fc5fabbbf0c1',volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:54:27.157933 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e44193f6-c550-4068-ac3a-6533c0d60b50 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730789 Jun 22 11:54:27.158553 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 395/839] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:54:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:54:27.165487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=4 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:54:27.166649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:54:27.171080 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e105656b-9bed-42d9-89d8-15fd411b273e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:27.171724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e105656b-9bed-42d9-89d8-15fd411b273e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:27.229530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e105656b-9bed-42d9-89d8-15fd411b273e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:27.236907 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e105656b-9bed-42d9-89d8-15fd411b273e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1092 microversion: 2.1 time: 0.072203 Jun 22 11:54:27.237507 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 445/840] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:27 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1092 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:28.255064 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-38044bb2-8e45-4e4a-86a9-8434e2bcf8e4 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:28.255783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-38044bb2-8e45-4e4a-86a9-8434e2bcf8e4 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:28.262885 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-38044bb2-8e45-4e4a-86a9-8434e2bcf8e4 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:28.263380 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-38044bb2-8e45-4e4a-86a9-8434e2bcf8e4 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:28.264150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-38044bb2-8e45-4e4a-86a9-8434e2bcf8e4 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:28.264583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-38044bb2-8e45-4e4a-86a9-8434e2bcf8e4 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:28.329982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-38044bb2-8e45-4e4a-86a9-8434e2bcf8e4 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:28.338283 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-38044bb2-8e45-4e4a-86a9-8434e2bcf8e4 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1208 microversion: 2.1 time: 0.087626 Jun 22 11:54:28.339049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 396/841] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:28 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:54:29.358209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9af1d773-09d9-4952-99f7-f44b9c6c39fb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:29.359987 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9af1d773-09d9-4952-99f7-f44b9c6c39fb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:29.368429 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9af1d773-09d9-4952-99f7-f44b9c6c39fb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:29.369060 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9af1d773-09d9-4952-99f7-f44b9c6c39fb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:29.370025 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9af1d773-09d9-4952-99f7-f44b9c6c39fb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:29.370624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9af1d773-09d9-4952-99f7-f44b9c6c39fb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:29.552456 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9af1d773-09d9-4952-99f7-f44b9c6c39fb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:29.561202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9af1d773-09d9-4952-99f7-f44b9c6c39fb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.208939 Jun 22 11:54:29.561799 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 446/842] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:29 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:29.638061 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-a82f6da5-0622-491a-8ad1-14bcad2f45b3 req-80602930-6552-4667-8951-4d6110ef2ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf7624b-dc26-4c19-91c9-0a2267b82315", "tag": "5844e5ac-0c8a-465c-b1c6-a814fc67c3d8"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:54:29.649013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-a82f6da5-0622-491a-8ad1-14bcad2f45b3 req-80602930-6552-4667-8951-4d6110ef2ad1 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:29.649594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-a82f6da5-0622-491a-8ad1-14bcad2f45b3 req-80602930-6552-4667-8951-4d6110ef2ad1 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:29.667836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-a82f6da5-0622-491a-8ad1-14bcad2f45b3 req-80602930-6552-4667-8951-4d6110ef2ad1 service nova] Creating event network-changed:5844e5ac-0c8a-465c-b1c6-a814fc67c3d8 for instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 on hv-cinder-83697 Jun 22 11:54:29.673496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-a82f6da5-0622-491a-8ad1-14bcad2f45b3 req-80602930-6552-4667-8951-4d6110ef2ad1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039757 Jun 22 11:54:29.674442 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 397/843] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:54:30.578932 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1bf18d93-32c6-4180-8a41-c778e6a1004f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:30.579857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1bf18d93-32c6-4180-8a41-c778e6a1004f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:30.586698 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1bf18d93-32c6-4180-8a41-c778e6a1004f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:30.587393 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1bf18d93-32c6-4180-8a41-c778e6a1004f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:30.588293 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1bf18d93-32c6-4180-8a41-c778e6a1004f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:30.588823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1bf18d93-32c6-4180-8a41-c778e6a1004f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:30.732650 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1bf18d93-32c6-4180-8a41-c778e6a1004f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:30.744410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1bf18d93-32c6-4180-8a41-c778e6a1004f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.166139 Jun 22 11:54:30.744410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 447/844] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:30 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:31.758370 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bc4d4888-a1e7-40a8-80f6-11c7c4591df2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:31.759088 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bc4d4888-a1e7-40a8-80f6-11c7c4591df2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:31.765636 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bc4d4888-a1e7-40a8-80f6-11c7c4591df2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:31.766081 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bc4d4888-a1e7-40a8-80f6-11c7c4591df2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:31.766842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bc4d4888-a1e7-40a8-80f6-11c7c4591df2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:31.767783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bc4d4888-a1e7-40a8-80f6-11c7c4591df2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:31.914871 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bc4d4888-a1e7-40a8-80f6-11c7c4591df2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:31.922855 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bc4d4888-a1e7-40a8-80f6-11c7c4591df2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.169268 Jun 22 11:54:31.932346 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 398/845] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:31 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:32.939717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4878142b-d1a8-494a-be2e-2d1cca2744ae tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:32.940222 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4878142b-d1a8-494a-be2e-2d1cca2744ae tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:32.946221 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4878142b-d1a8-494a-be2e-2d1cca2744ae tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:32.946658 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4878142b-d1a8-494a-be2e-2d1cca2744ae tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:32.947474 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4878142b-d1a8-494a-be2e-2d1cca2744ae tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:32.947898 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4878142b-d1a8-494a-be2e-2d1cca2744ae tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:33.076028 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4878142b-d1a8-494a-be2e-2d1cca2744ae tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:33.083938 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4878142b-d1a8-494a-be2e-2d1cca2744ae tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.148204 Jun 22 11:54:33.084487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 448/846] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:32 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:34.101212 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-807fe9cd-895a-41f6-8db7-4a0a94a73a1a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:34.101805 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-807fe9cd-895a-41f6-8db7-4a0a94a73a1a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:34.108315 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-807fe9cd-895a-41f6-8db7-4a0a94a73a1a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:34.108771 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-807fe9cd-895a-41f6-8db7-4a0a94a73a1a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:34.109504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-807fe9cd-895a-41f6-8db7-4a0a94a73a1a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:34.109928 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-807fe9cd-895a-41f6-8db7-4a0a94a73a1a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:34.242089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-807fe9cd-895a-41f6-8db7-4a0a94a73a1a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:34.249666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-807fe9cd-895a-41f6-8db7-4a0a94a73a1a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.152263 Jun 22 11:54:34.250223 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 399/847] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:34 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:35.266240 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c9f962b9-4515-443d-8f2b-58d9de4feb5b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:35.266842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c9f962b9-4515-443d-8f2b-58d9de4feb5b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:35.272901 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c9f962b9-4515-443d-8f2b-58d9de4feb5b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:35.273353 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c9f962b9-4515-443d-8f2b-58d9de4feb5b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:35.274110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c9f962b9-4515-443d-8f2b-58d9de4feb5b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:35.274539 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c9f962b9-4515-443d-8f2b-58d9de4feb5b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:35.405126 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c9f962b9-4515-443d-8f2b-58d9de4feb5b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:35.412716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c9f962b9-4515-443d-8f2b-58d9de4feb5b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.150584 Jun 22 11:54:35.413285 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 449/848] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:35 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:36.430697 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-73b53126-e02f-4f83-b4ad-0018ffffc8ee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:36.431430 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-73b53126-e02f-4f83-b4ad-0018ffffc8ee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:36.438153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73b53126-e02f-4f83-b4ad-0018ffffc8ee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:36.438658 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73b53126-e02f-4f83-b4ad-0018ffffc8ee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:36.439490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73b53126-e02f-4f83-b4ad-0018ffffc8ee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:36.439923 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73b53126-e02f-4f83-b4ad-0018ffffc8ee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:36.578151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-73b53126-e02f-4f83-b4ad-0018ffffc8ee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:36.585552 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-73b53126-e02f-4f83-b4ad-0018ffffc8ee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.158868 Jun 22 11:54:36.586102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 400/849] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:36 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:37.602623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-190397eb-940a-41f1-8dee-885b40d2e1b2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:37.603216 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-190397eb-940a-41f1-8dee-885b40d2e1b2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:37.605126 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:54:37.610593 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-190397eb-940a-41f1-8dee-885b40d2e1b2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:37.611577 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-190397eb-940a-41f1-8dee-885b40d2e1b2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:37.612054 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-190397eb-940a-41f1-8dee-885b40d2e1b2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:37.612492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-190397eb-940a-41f1-8dee-885b40d2e1b2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:37.755615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-190397eb-940a-41f1-8dee-885b40d2e1b2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:37.763842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-190397eb-940a-41f1-8dee-885b40d2e1b2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.165026 Jun 22 11:54:37.773802 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 450/850] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:37 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:38.780480 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-123112f1-375e-47ea-9723-2ca6775ed17e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:38.781093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-123112f1-375e-47ea-9723-2ca6775ed17e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:38.783605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:54:38.784269 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=6 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:54:38.791142 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-123112f1-375e-47ea-9723-2ca6775ed17e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:38.791613 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-123112f1-375e-47ea-9723-2ca6775ed17e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:38.792386 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-123112f1-375e-47ea-9723-2ca6775ed17e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:38.792987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-123112f1-375e-47ea-9723-2ca6775ed17e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:38.942454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-123112f1-375e-47ea-9723-2ca6775ed17e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:38.950057 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-123112f1-375e-47ea-9723-2ca6775ed17e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.173334 Jun 22 11:54:38.950624 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 401/851] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:38 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:39.967792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1f297606-04fb-47fe-8dff-85f15eca5eba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:39.968557 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1f297606-04fb-47fe-8dff-85f15eca5eba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:39.974947 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f297606-04fb-47fe-8dff-85f15eca5eba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:39.975416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f297606-04fb-47fe-8dff-85f15eca5eba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:39.976242 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f297606-04fb-47fe-8dff-85f15eca5eba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:39.976626 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f297606-04fb-47fe-8dff-85f15eca5eba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:40.119954 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1f297606-04fb-47fe-8dff-85f15eca5eba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:40.127461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1f297606-04fb-47fe-8dff-85f15eca5eba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.163486 Jun 22 11:54:40.128018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 451/852] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:39 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:54:41.144913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-209ecca2-f5f6-4656-aff6-b946cd3e7f98 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:41.145512 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-209ecca2-f5f6-4656-aff6-b946cd3e7f98 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:41.151963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-209ecca2-f5f6-4656-aff6-b946cd3e7f98 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:41.152405 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-209ecca2-f5f6-4656-aff6-b946cd3e7f98 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:41.153158 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-209ecca2-f5f6-4656-aff6-b946cd3e7f98 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:41.153584 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-209ecca2-f5f6-4656-aff6-b946cd3e7f98 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:41.280929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-209ecca2-f5f6-4656-aff6-b946cd3e7f98 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:41.288594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-209ecca2-f5f6-4656-aff6-b946cd3e7f98 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.148005 Jun 22 11:54:41.289504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 402/853] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:41 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:54:41.552498 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-680aaf07-d161-4f8e-990c-df359e7aa1be req-30249080-4264-4cba-a87b-e95304d46288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf7624b-dc26-4c19-91c9-0a2267b82315", "name": "network-vif-plugged", "status": "completed", "tag": "5844e5ac-0c8a-465c-b1c6-a814fc67c3d8"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:54:41.560583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-680aaf07-d161-4f8e-990c-df359e7aa1be req-30249080-4264-4cba-a87b-e95304d46288 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:41.561026 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-680aaf07-d161-4f8e-990c-df359e7aa1be req-30249080-4264-4cba-a87b-e95304d46288 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:41.572546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-680aaf07-d161-4f8e-990c-df359e7aa1be req-30249080-4264-4cba-a87b-e95304d46288 service nova] Creating event network-vif-plugged:5844e5ac-0c8a-465c-b1c6-a814fc67c3d8 for instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 on hv-cinder-83697 Jun 22 11:54:41.577435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-680aaf07-d161-4f8e-990c-df359e7aa1be req-30249080-4264-4cba-a87b-e95304d46288 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029224 Jun 22 11:54:41.578077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 452/854] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:54:42.308038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3c81a696-77e2-428e-be6d-eb7b33c7b770 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:42.308595 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3c81a696-77e2-428e-be6d-eb7b33c7b770 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:42.315623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c81a696-77e2-428e-be6d-eb7b33c7b770 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:42.316062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c81a696-77e2-428e-be6d-eb7b33c7b770 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:42.316821 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c81a696-77e2-428e-be6d-eb7b33c7b770 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:42.317227 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c81a696-77e2-428e-be6d-eb7b33c7b770 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:42.450603 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3c81a696-77e2-428e-be6d-eb7b33c7b770 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:42.458750 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3c81a696-77e2-428e-be6d-eb7b33c7b770 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1263 microversion: 2.1 time: 0.154589 Jun 22 11:54:42.459308 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 403/855] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:42 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:43.530147 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-46b7ccbe-a130-40a6-9794-e70eb3541f4c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:43.530757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-46b7ccbe-a130-40a6-9794-e70eb3541f4c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:43.537311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-46b7ccbe-a130-40a6-9794-e70eb3541f4c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:43.537754 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-46b7ccbe-a130-40a6-9794-e70eb3541f4c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:43.538514 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-46b7ccbe-a130-40a6-9794-e70eb3541f4c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:43.538943 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-46b7ccbe-a130-40a6-9794-e70eb3541f4c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:43.676564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-46b7ccbe-a130-40a6-9794-e70eb3541f4c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:43.684083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-46b7ccbe-a130-40a6-9794-e70eb3541f4c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1451 microversion: 2.1 time: 0.158402 Jun 22 11:54:43.684723 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 453/856] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:43 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:43.700786 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5c6a7e5a-071f-4074-af32-ea7fa18f6b5c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:43.701392 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5c6a7e5a-071f-4074-af32-ea7fa18f6b5c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:43.707451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5c6a7e5a-071f-4074-af32-ea7fa18f6b5c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:43.707894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5c6a7e5a-071f-4074-af32-ea7fa18f6b5c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:43.708656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5c6a7e5a-071f-4074-af32-ea7fa18f6b5c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:43.709081 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5c6a7e5a-071f-4074-af32-ea7fa18f6b5c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:43.840089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5c6a7e5a-071f-4074-af32-ea7fa18f6b5c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:43.847982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5c6a7e5a-071f-4074-af32-ea7fa18f6b5c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1451 microversion: 2.1 time: 0.151150 Jun 22 11:54:43.848536 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 404/857] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:43 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:45.625410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-dee3d184-cf7d-48af-8c21-a4c06eb3f15d req-64f972b6-fd51-4dce-88cd-f9e1341fb526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf7624b-dc26-4c19-91c9-0a2267b82315", "tag": "5844e5ac-0c8a-465c-b1c6-a814fc67c3d8"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:54:45.634079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-dee3d184-cf7d-48af-8c21-a4c06eb3f15d req-64f972b6-fd51-4dce-88cd-f9e1341fb526 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:45.634622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-dee3d184-cf7d-48af-8c21-a4c06eb3f15d req-64f972b6-fd51-4dce-88cd-f9e1341fb526 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:45.646881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-dee3d184-cf7d-48af-8c21-a4c06eb3f15d req-64f972b6-fd51-4dce-88cd-f9e1341fb526 service nova] Creating event network-changed:5844e5ac-0c8a-465c-b1c6-a814fc67c3d8 for instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 on hv-cinder-83697 Jun 22 11:54:45.652352 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-dee3d184-cf7d-48af-8c21-a4c06eb3f15d req-64f972b6-fd51-4dce-88cd-f9e1341fb526 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031193 Jun 22 11:54:45.653253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 454/858] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:54:48.663237 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c9b89771-f9ac-41a4-ad76-742545b18b1c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:48.664049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c9b89771-f9ac-41a4-ad76-742545b18b1c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:48.666018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-1deafc82-daff-4c21-9073-007ae36b134b req-71cf23fd-92f8-4f1d-8bd2-a30882b30229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3eb4a54-d3df-4eca-b1ef-3dcb13716d61", "tag": "372fe7e2-a11e-410a-ad0b-3ed41c865845"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:54:48.672363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9b89771-f9ac-41a4-ad76-742545b18b1c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:48.672949 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9b89771-f9ac-41a4-ad76-742545b18b1c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:48.673989 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9b89771-f9ac-41a4-ad76-742545b18b1c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:48.674625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9b89771-f9ac-41a4-ad76-742545b18b1c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:48.675005 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-1deafc82-daff-4c21-9073-007ae36b134b req-71cf23fd-92f8-4f1d-8bd2-a30882b30229 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:48.675476 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-1deafc82-daff-4c21-9073-007ae36b134b req-71cf23fd-92f8-4f1d-8bd2-a30882b30229 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:48.688151 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-1deafc82-daff-4c21-9073-007ae36b134b req-71cf23fd-92f8-4f1d-8bd2-a30882b30229 service nova] Creating event network-changed:372fe7e2-a11e-410a-ad0b-3ed41c865845 for instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 on hv-cinder-83697 Jun 22 11:54:48.692993 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-1deafc82-daff-4c21-9073-007ae36b134b req-71cf23fd-92f8-4f1d-8bd2-a30882b30229 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030915 Jun 22 11:54:48.693764 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 455/859] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:54:48.701219 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c9b89771-f9ac-41a4-ad76-742545b18b1c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:54:48.779263 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c9b89771-f9ac-41a4-ad76-742545b18b1c tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 204 len: 0 microversion: 2.1 time: 0.119577 Jun 22 11:54:48.779796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 405/860] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:54:48 2022] DELETE /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:54:48.789343 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6a81f902-b19a-42c4-a37a-681b520dc798 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:48.790126 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6a81f902-b19a-42c4-a37a-681b520dc798 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:48.796612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6a81f902-b19a-42c4-a37a-681b520dc798 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:48.797047 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6a81f902-b19a-42c4-a37a-681b520dc798 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:48.797798 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6a81f902-b19a-42c4-a37a-681b520dc798 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:48.798254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6a81f902-b19a-42c4-a37a-681b520dc798 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:48.929875 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6a81f902-b19a-42c4-a37a-681b520dc798 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:48.937501 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6a81f902-b19a-42c4-a37a-681b520dc798 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.152341 Jun 22 11:54:48.938074 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 456/861] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:48 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:54:49.956482 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-648a5bf2-d6bd-464c-8f15-8a36a4d75b21 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:49.957196 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-648a5bf2-d6bd-464c-8f15-8a36a4d75b21 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:49.963858 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-648a5bf2-d6bd-464c-8f15-8a36a4d75b21 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:49.964296 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-648a5bf2-d6bd-464c-8f15-8a36a4d75b21 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:49.965049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-648a5bf2-d6bd-464c-8f15-8a36a4d75b21 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:49.965473 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-648a5bf2-d6bd-464c-8f15-8a36a4d75b21 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:50.098916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-648a5bf2-d6bd-464c-8f15-8a36a4d75b21 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:50.106325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-648a5bf2-d6bd-464c-8f15-8a36a4d75b21 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.154038 Jun 22 11:54:50.106878 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 406/862] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:49 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:51.124011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c537e893-1dda-4bc2-83e1-c799c738bca3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:51.124654 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c537e893-1dda-4bc2-83e1-c799c738bca3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:51.132454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c537e893-1dda-4bc2-83e1-c799c738bca3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:51.132989 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c537e893-1dda-4bc2-83e1-c799c738bca3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:51.133736 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c537e893-1dda-4bc2-83e1-c799c738bca3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:51.134168 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c537e893-1dda-4bc2-83e1-c799c738bca3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:51.269108 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c537e893-1dda-4bc2-83e1-c799c738bca3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:51.277199 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c537e893-1dda-4bc2-83e1-c799c738bca3 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.156994 Jun 22 11:54:51.277824 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 457/863] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:51 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:52.294970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-56598dd9-181c-4498-ae9b-b63476cca960 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:52.295634 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-56598dd9-181c-4498-ae9b-b63476cca960 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:52.308539 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-56598dd9-181c-4498-ae9b-b63476cca960 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:52.308982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-56598dd9-181c-4498-ae9b-b63476cca960 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:52.309735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-56598dd9-181c-4498-ae9b-b63476cca960 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:52.310168 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-56598dd9-181c-4498-ae9b-b63476cca960 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:52.444113 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-56598dd9-181c-4498-ae9b-b63476cca960 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:52.452543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-56598dd9-181c-4498-ae9b-b63476cca960 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1568 microversion: 2.1 time: 0.161545 Jun 22 11:54:52.453424 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 407/864] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:52 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:53.470240 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2f11390e-e0b2-4f8f-8bf2-1c9cc6fdef88 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:53.470828 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2f11390e-e0b2-4f8f-8bf2-1c9cc6fdef88 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:53.477536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2f11390e-e0b2-4f8f-8bf2-1c9cc6fdef88 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:53.477976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2f11390e-e0b2-4f8f-8bf2-1c9cc6fdef88 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:53.478742 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2f11390e-e0b2-4f8f-8bf2-1c9cc6fdef88 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:53.479167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2f11390e-e0b2-4f8f-8bf2-1c9cc6fdef88 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:53.608924 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2f11390e-e0b2-4f8f-8bf2-1c9cc6fdef88 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:53.616801 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2f11390e-e0b2-4f8f-8bf2-1c9cc6fdef88 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1450 microversion: 2.1 time: 0.150299 Jun 22 11:54:53.617666 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 458/865] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:53 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:53.804371 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-843b844e-d15b-4b40-bbda-a59f85807124 req-34cce107-bcc2-47e7-bd57-278eb62ac8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3eb4a54-d3df-4eca-b1ef-3dcb13716d61", "name": "network-vif-deleted", "tag": "372fe7e2-a11e-410a-ad0b-3ed41c865845"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:54:53.812629 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-843b844e-d15b-4b40-bbda-a59f85807124 req-34cce107-bcc2-47e7-bd57-278eb62ac8d7 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:53.812998 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-843b844e-d15b-4b40-bbda-a59f85807124 req-34cce107-bcc2-47e7-bd57-278eb62ac8d7 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:53.826000 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-843b844e-d15b-4b40-bbda-a59f85807124 req-34cce107-bcc2-47e7-bd57-278eb62ac8d7 service nova] Creating event network-vif-deleted:372fe7e2-a11e-410a-ad0b-3ed41c865845 for instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 on hv-cinder-83697 Jun 22 11:54:53.831496 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-843b844e-d15b-4b40-bbda-a59f85807124 req-34cce107-bcc2-47e7-bd57-278eb62ac8d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031111 Jun 22 11:54:53.832250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 408/866] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:54:54.634258 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:54.634869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:54.641297 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:54.641830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:54.645000 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:54.645551 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:54.679301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:54.679859 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:54.680365 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lazy-loading 'fault' on Instance uuid a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:54:54.724971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58976549233e4bb6991258f7da1123ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4845f1df49c64dcc8c4a48691fae9a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:54:54.732618 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f089b58a-30a0-4385-98ef-673c45455213 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 200 len: 1224 microversion: 2.1 time: 0.102172 Jun 22 11:54:54.733185 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 459/867] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:54 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:54:55.750058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:55.750656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] [instance: a3eb4a54-d3df-4eca-b1ef-3dcb13716d61] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:54:55.756922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:55.757366 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:55.758369 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:54:55.758891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:54:55.773815 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] HTTP exception thrown: Instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 could not be found. Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Request method failure captured: Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 HTTP/1.1 Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswFZG49rDVek5NpqawNdhef0HCvi5ATjB86ol6Q_oGz_oHc4HuTtkMLnPFpTdmgCBfyM9Tdx8UkgoSVArox6OsVGN0ady6EISPpjOLUL1euSF9h7nFjV-_9-7pfkho5yRIG9ryfPXrKAeP-4hIwGzbBDRgNufYCqukYBG-AU_iIFh9E Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 4845f1df49c64dcc8c4a48691fae9a27 Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-TestShelveInstance-887226335 Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:54:55.775485 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4845f1df49c64dcc8c4a48691fae9a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4845f1df49c64dcc8c4a48691fae9a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4845f1df49c64dcc8c4a48691fae9a27", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4845f1df49c64dcc8c4a48691fae9a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-TestShelveInstance-887226335 Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 4845f1df49c64dcc8c4a48691fae9a27 Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-TestShelveInstance-887226335 Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-TestShelveInstance-887226335-project Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 58976549233e4bb6991258f7da1123ae Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-TestShelveInstance-887226335-project Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 could not be found. Jun 22 11:54:55.777099 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'a3eb4a54-d3df-4eca-b1ef-3dcb13716d61'} Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 could not be found. Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:54:55.778046 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 could not be found. Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 could not be found. Jun 22 11:54:55.779400 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:54:55.780550 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Returning 404 to user: Instance a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:54:55.780550 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b6674aaa-9412-40b9-b568-9af383b92dc7 tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61" status: 404 len: 111 microversion: 2.1 time: 0.031557 Jun 22 11:54:55.780550 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 409/868] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:54:55 2022] GET /compute/v2.1/servers/a3eb4a54-d3df-4eca-b1ef-3dcb13716d61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:54:55.947200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-55c5230d-d197-439f-80f6-e5236623024d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] Calling method '.version_select at 0x7f3ea80d53a0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:54:55.968786 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-55c5230d-d197-439f-80f6-e5236623024d tempest-TestShelveInstance-887226335 tempest-TestShelveInstance-887226335-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1723268586" status: 202 len: 0 microversion: 2.1 time: 0.025331 Jun 22 11:54:55.969394 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 460/869] 10.222.0.36 () {58 vars in 1253 bytes} [Wed Jun 22 11:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1723268586 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:55:31.352415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d519cbb9-f079-4276-bac9-e60ac29ba4e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:31.352959 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d519cbb9-f079-4276-bac9-e60ac29ba4e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:31.354991 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:55:31.355772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:55:31.361741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d519cbb9-f079-4276-bac9-e60ac29ba4e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:31.362175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d519cbb9-f079-4276-bac9-e60ac29ba4e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:31.362922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d519cbb9-f079-4276-bac9-e60ac29ba4e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:31.363369 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d519cbb9-f079-4276-bac9-e60ac29ba4e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:31.389778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d519cbb9-f079-4276-bac9-e60ac29ba4e6 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/ips" status: 200 len: 145 microversion: 2.1 time: 0.041254 Jun 22 11:55:31.390342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 410/870] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 11:55:31 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:55:34.798988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=74 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:55:34.799854 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:55:34.804972 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ce0cda80-240a-42dc-b67b-ecfa6f3ee357 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "913b4912-c7a4-4d84-b9bc-7dca58be8b1b"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:55:34.806032 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ce0cda80-240a-42dc-b67b-ecfa6f3ee357 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:34.813834 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ce0cda80-240a-42dc-b67b-ecfa6f3ee357 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:34.814282 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ce0cda80-240a-42dc-b67b-ecfa6f3ee357 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:34.815046 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ce0cda80-240a-42dc-b67b-ecfa6f3ee357 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:34.815512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ce0cda80-240a-42dc-b67b-ecfa6f3ee357 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:35.220516 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ce0cda80-240a-42dc-b67b-ecfa6f3ee357 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422162 Jun 22 11:55:35.221145 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 461/871] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 11:55:34 2022] POST /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:55:45.638018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d10f929c-69f4-4ebb-b300-17698d6084de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:45.638885 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d10f929c-69f4-4ebb-b300-17698d6084de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:45.641013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:55:45.641944 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:55:45.648516 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d10f929c-69f4-4ebb-b300-17698d6084de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:45.648952 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d10f929c-69f4-4ebb-b300-17698d6084de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:45.649710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d10f929c-69f4-4ebb-b300-17698d6084de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:45.650221 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d10f929c-69f4-4ebb-b300-17698d6084de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:45.674948 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d10f929c-69f4-4ebb-b300-17698d6084de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/ips" status: 200 len: 152 microversion: 2.20 time: 0.040809 Jun 22 11:55:45.675522 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 411/872] 10.222.0.36 () {60 vars in 1288 bytes} [Wed Jun 22 11:55:45 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:55:46.950636 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:55:46.951422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:55:46.955945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-67a5d7cf-1eab-4845-94d8-1daa51983469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:46.956997 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-67a5d7cf-1eab-4845-94d8-1daa51983469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:46.964445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-67a5d7cf-1eab-4845-94d8-1daa51983469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:46.964888 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-67a5d7cf-1eab-4845-94d8-1daa51983469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:46.965638 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-67a5d7cf-1eab-4845-94d8-1daa51983469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:46.966063 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-67a5d7cf-1eab-4845-94d8-1daa51983469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:46.995985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-67a5d7cf-1eab-4845-94d8-1daa51983469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046931 Jun 22 11:55:46.996822 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 462/873] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:55:46 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:55:47.006504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-87ae70bb-3721-4c22-a640-23b1665b636b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:47.007064 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-87ae70bb-3721-4c22-a640-23b1665b636b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:47.014172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-87ae70bb-3721-4c22-a640-23b1665b636b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:47.014481 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-87ae70bb-3721-4c22-a640-23b1665b636b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:47.020443 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-87ae70bb-3721-4c22-a640-23b1665b636b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:47.021705 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-87ae70bb-3721-4c22-a640-23b1665b636b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:47.052060 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-87ae70bb-3721-4c22-a640-23b1665b636b tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/913b4912-c7a4-4d84-b9bc-7dca58be8b1b" status: 200 len: 194 microversion: 2.1 time: 0.049525 Jun 22 11:55:47.052646 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 412/874] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Jun 22 11:55:47 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/913b4912-c7a4-4d84-b9bc-7dca58be8b1b => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:55:48.376314 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ae15fb7d-04c7-4c83-8163-a106a9dba8c9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc285523-0ef5-44c1-944b-0180b0d5ae1e"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:55:48.377353 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ae15fb7d-04c7-4c83-8163-a106a9dba8c9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:48.383674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ae15fb7d-04c7-4c83-8163-a106a9dba8c9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:48.384112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ae15fb7d-04c7-4c83-8163-a106a9dba8c9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:48.384858 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ae15fb7d-04c7-4c83-8163-a106a9dba8c9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:48.385283 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ae15fb7d-04c7-4c83-8163-a106a9dba8c9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:48.605013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4b84eeef-7d67-4177-baf1-baed8a6007c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:55:48.605702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4b84eeef-7d67-4177-baf1-baed8a6007c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:48.615402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4b84eeef-7d67-4177-baf1-baed8a6007c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:48.615858 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4b84eeef-7d67-4177-baf1-baed8a6007c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:48.616967 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4b84eeef-7d67-4177-baf1-baed8a6007c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:48.617402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4b84eeef-7d67-4177-baf1-baed8a6007c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:48.642593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-4b84eeef-7d67-4177-baf1-baed8a6007c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lazy-loading 'flavor' on Instance uuid 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:55:48.672492 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ae15fb7d-04c7-4c83-8163-a106a9dba8c9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "POST /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299866 Jun 22 11:55:48.673254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 463/875] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 11:55:48 2022] POST /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:55:49.006661 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4b84eeef-7d67-4177-baf1-baed8a6007c2 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/action" status: 202 len: 0 microversion: 2.20 time: 0.405825 Jun 22 11:55:49.007337 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 413/876] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Jun 22 11:55:48 2022] POST /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 22 11:55:49.017484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:49.018177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:49.025058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:49.025507 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:49.026280 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:49.026719 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:49.164068 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:49.171900 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:49.173391 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:49.174537 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a15f8c0e-555a-4a4c-814d-a58a33ae7230 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.162044 Jun 22 11:55:49.175080 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 464/877] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:49 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:50.194862 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:50.195656 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:50.202251 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:50.202689 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:50.203474 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:50.203900 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:50.333161 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:50.341185 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:50.342659 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:50.343840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-553be8aa-a34d-475c-9e51-6288c6a2cb1c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.153725 Jun 22 11:55:50.344395 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 414/878] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:50 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:51.362731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:51.363335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:51.370245 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:51.370691 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:51.371483 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:51.371997 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:51.501539 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:51.510271 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:51.511790 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:51.512992 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-a97fc174-c8c4-467e-a9ce-893eae45aca0 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.154198 Jun 22 11:55:51.513745 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 465/879] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:51 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:52.530891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:52.531537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:52.538324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:52.538753 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:52.540193 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:52.540622 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:52.678637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:52.686418 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:52.689730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:52.689730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2612baf6-6ea4-4632-97ea-05a1b2df3688 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.162045 Jun 22 11:55:52.689730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 415/880] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:52 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:53.707189 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:53.707851 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:53.714169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:53.714615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:53.715385 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:53.715818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:53.856279 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:53.864169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:53.865674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:53.866816 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0f7ac920-c813-4378-9e69-b36e98393424 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.163602 Jun 22 11:55:53.867958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 466/881] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:53 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:54.886375 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:54.886932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:54.894153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:54.894596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:54.895583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:54.896017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:55.030113 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:55.038307 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:55.039858 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:55.041024 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e0e4f220-fed5-4333-91da-d086e0e4d643 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.159188 Jun 22 11:55:55.041576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 416/882] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:54 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:56.059883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:56.060474 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:56.067190 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:56.067666 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:56.068416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:56.068842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:56.201252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:56.209316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:56.210804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:56.212591 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-edeeb5e5-8c4d-41d1-b6af-d8130e5cac5e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.156616 Jun 22 11:55:56.213139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 467/883] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:56 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:57.231402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:57.231926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:57.238426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:57.238864 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:57.239640 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:57.240066 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:57.366691 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:57.374685 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:57.376208 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:57.377351 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9dfafaac-73c6-4314-8653-384b606567ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.150474 Jun 22 11:55:57.377901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 417/884] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:57 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:58.395774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:58.396382 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:58.403589 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:58.404022 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:58.404776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:58.405209 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:58.533390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:58.541290 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:58.542787 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:58.543970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-69b8795d-666c-4176-92d9-cfe4787da42d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.152225 Jun 22 11:55:58.544540 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 468/885] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:58 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:55:59.562448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:55:59.562986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:55:59.569510 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:59.569956 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:59.570716 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:55:59.571143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:55:59.704566 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:59.712932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:59.714422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:55:59.715595 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-871b5367-b8cc-4abf-bda4-491222d49e40 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.157126 Jun 22 11:55:59.716147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 418/886] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:55:59 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:00.383873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5147d092-74ba-4045-9f43-579dcadb057c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:00.384830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5147d092-74ba-4045-9f43-579dcadb057c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:00.391597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5147d092-74ba-4045-9f43-579dcadb057c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:00.392048 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5147d092-74ba-4045-9f43-579dcadb057c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:00.392808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5147d092-74ba-4045-9f43-579dcadb057c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:00.393245 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5147d092-74ba-4045-9f43-579dcadb057c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:00.421715 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5147d092-74ba-4045-9f43-579dcadb057c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042323 Jun 22 11:56:00.422252 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 469/887] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:56:00 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:00.573039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-05e80b18-8482-42e2-9fb6-9d38a9b8f2ad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:00.573559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-05e80b18-8482-42e2-9fb6-9d38a9b8f2ad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:00.579864 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-05e80b18-8482-42e2-9fb6-9d38a9b8f2ad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:00.580302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-05e80b18-8482-42e2-9fb6-9d38a9b8f2ad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:00.581048 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-05e80b18-8482-42e2-9fb6-9d38a9b8f2ad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:00.581474 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-05e80b18-8482-42e2-9fb6-9d38a9b8f2ad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:00.609786 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-05e80b18-8482-42e2-9fb6-9d38a9b8f2ad tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/913b4912-c7a4-4d84-b9bc-7dca58be8b1b" status: 200 len: 194 microversion: 2.1 time: 0.040729 Jun 22 11:56:00.610352 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 419/888] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Jun 22 11:56:00 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/913b4912-c7a4-4d84-b9bc-7dca58be8b1b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:00.620451 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6aadb4b3-340d-4b74-9eb4-4ae5adc50469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:00.620942 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6aadb4b3-340d-4b74-9eb4-4ae5adc50469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:00.626862 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6aadb4b3-340d-4b74-9eb4-4ae5adc50469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:00.627302 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6aadb4b3-340d-4b74-9eb4-4ae5adc50469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:00.628108 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6aadb4b3-340d-4b74-9eb4-4ae5adc50469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:00.628536 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6aadb4b3-340d-4b74-9eb4-4ae5adc50469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:00.708092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-6aadb4b3-340d-4b74-9eb4-4ae5adc50469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lazy-loading 'services' on Instance uuid c949fdfd-21bc-4762-9e00-db7937f32e69 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:56:00.736050 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:00.736751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:00.743680 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:00.744202 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:00.745025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:00.745539 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:00.782771 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6aadb4b3-340d-4b74-9eb4-4ae5adc50469 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/913b4912-c7a4-4d84-b9bc-7dca58be8b1b" status: 202 len: 0 microversion: 2.1 time: 0.166523 Jun 22 11:56:00.783750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 470/889] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 11:56:00 2022] DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/913b4912-c7a4-4d84-b9bc-7dca58be8b1b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:56:00.882879 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:00.891799 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:00.893337 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:00.894602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-83c939bf-1f4c-4ce0-b650-ecbeb5d90c15 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.162603 Jun 22 11:56:00.899735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 420/890] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:00 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:01.914999 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:01.915849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:01.922788 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:01.923238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:01.924038 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:01.924466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:02.066222 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:02.075437 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:02.076973 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:02.078271 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-97cae601-8450-4f57-abfb-1dc70b45579d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.168637 Jun 22 11:56:02.089799 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 471/891] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:01 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:02.971599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-78cd9f7c-84ce-4864-8358-0535dd8f55a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:02.972179 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-78cd9f7c-84ce-4864-8358-0535dd8f55a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:02.979291 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-78cd9f7c-84ce-4864-8358-0535dd8f55a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:02.979759 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-78cd9f7c-84ce-4864-8358-0535dd8f55a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:02.980533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-78cd9f7c-84ce-4864-8358-0535dd8f55a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:02.980965 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-78cd9f7c-84ce-4864-8358-0535dd8f55a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:03.012384 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-78cd9f7c-84ce-4864-8358-0535dd8f55a1 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/fc285523-0ef5-44c1-944b-0180b0d5ae1e" status: 200 len: 194 microversion: 2.1 time: 0.044831 Jun 22 11:56:03.012998 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 421/892] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Jun 22 11:56:02 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/fc285523-0ef5-44c1-944b-0180b0d5ae1e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:03.023162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-676d5de3-c525-4f52-aa1b-2b44f518c42c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:03.023826 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-676d5de3-c525-4f52-aa1b-2b44f518c42c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:03.030279 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676d5de3-c525-4f52-aa1b-2b44f518c42c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:03.030725 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676d5de3-c525-4f52-aa1b-2b44f518c42c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:03.031545 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676d5de3-c525-4f52-aa1b-2b44f518c42c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:03.031978 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-676d5de3-c525-4f52-aa1b-2b44f518c42c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:03.098238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:03.098849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:03.106316 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:03.107116 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:03.108361 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:03.108855 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:03.121383 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-676d5de3-c525-4f52-aa1b-2b44f518c42c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lazy-loading 'services' on Instance uuid c949fdfd-21bc-4762-9e00-db7937f32e69 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:56:03.197140 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-676d5de3-c525-4f52-aa1b-2b44f518c42c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/fc285523-0ef5-44c1-944b-0180b0d5ae1e" status: 202 len: 0 microversion: 2.1 time: 0.177405 Jun 22 11:56:03.197829 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 472/893] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 11:56:03 2022] DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments/fc285523-0ef5-44c1-944b-0180b0d5ae1e => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:56:03.248735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:03.260134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:03.261684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:03.262911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7e25822c-2118-4287-be4d-40e152afade7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.169103 Jun 22 11:56:03.263481 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 422/894] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:03 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:04.282445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:04.283203 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:04.290306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.290750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.291591 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.291960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.376608 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-07e1f80d-9713-48f8-aa1a-21e4468b7c0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:04.377575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-07e1f80d-9713-48f8-aa1a-21e4468b7c0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:04.384135 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-07e1f80d-9713-48f8-aa1a-21e4468b7c0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.384571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-07e1f80d-9713-48f8-aa1a-21e4468b7c0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.385331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-07e1f80d-9713-48f8-aa1a-21e4468b7c0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.385759 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-07e1f80d-9713-48f8-aa1a-21e4468b7c0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.415176 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-07e1f80d-9713-48f8-aa1a-21e4468b7c0d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042468 Jun 22 11:56:04.415766 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 423/895] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:56:04 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 11:56:04.424778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:04.433572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:04.435057 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:04.436228 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-aa0440d6-f763-4dad-8007-76f236cffe89 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.158025 Jun 22 11:56:04.436777 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 473/896] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:04 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:04.520262 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6a966d3c-6a2b-47c1-bb61-315f7588a8b2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:04.521212 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6a966d3c-6a2b-47c1-bb61-315f7588a8b2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:04.527506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6a966d3c-6a2b-47c1-bb61-315f7588a8b2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.527950 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6a966d3c-6a2b-47c1-bb61-315f7588a8b2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.528894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6a966d3c-6a2b-47c1-bb61-315f7588a8b2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.529366 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6a966d3c-6a2b-47c1-bb61-315f7588a8b2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.558570 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6a966d3c-6a2b-47c1-bb61-315f7588a8b2 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042158 Jun 22 11:56:04.559137 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 424/897] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 11:56:04 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 11:56:04.615475 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e0568197-b71f-4968-98d8-0bf71582d45d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:04.615968 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e0568197-b71f-4968-98d8-0bf71582d45d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:04.622520 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e0568197-b71f-4968-98d8-0bf71582d45d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.622966 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e0568197-b71f-4968-98d8-0bf71582d45d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.623746 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e0568197-b71f-4968-98d8-0bf71582d45d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.624170 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e0568197-b71f-4968-98d8-0bf71582d45d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.649201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e0568197-b71f-4968-98d8-0bf71582d45d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:56:04.682381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:56:04.725357 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e0568197-b71f-4968-98d8-0bf71582d45d tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 204 len: 0 microversion: 2.1 time: 0.113409 Jun 22 11:56:04.725988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 474/898] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:56:04 2022] DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:56:04.735297 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5cfbeea1-6d1f-47db-bc3c-48aa857e640e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:04.735949 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5cfbeea1-6d1f-47db-bc3c-48aa857e640e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:04.741822 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5cfbeea1-6d1f-47db-bc3c-48aa857e640e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.742260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5cfbeea1-6d1f-47db-bc3c-48aa857e640e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.743005 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5cfbeea1-6d1f-47db-bc3c-48aa857e640e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:04.743455 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5cfbeea1-6d1f-47db-bc3c-48aa857e640e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:04.870867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5cfbeea1-6d1f-47db-bc3c-48aa857e640e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:04.874592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:56:04.879791 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5cfbeea1-6d1f-47db-bc3c-48aa857e640e tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1673 microversion: 2.1 time: 0.148426 Jun 22 11:56:04.880329 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 425/899] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:56:04 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:56:05.455053 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:05.455871 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:05.462486 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:05.462924 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:05.463780 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:05.464251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:05.597615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:05.606024 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:05.607538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:05.608669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6aad41d2-7762-446a-8505-dd52e127c107 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.157885 Jun 22 11:56:05.609250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 475/900] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:05 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:05.898018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-53459910-0c51-49c3-ae75-3b078f1f4238 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:05.899332 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-53459910-0c51-49c3-ae75-3b078f1f4238 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:05.906682 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-53459910-0c51-49c3-ae75-3b078f1f4238 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:05.907144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-53459910-0c51-49c3-ae75-3b078f1f4238 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:05.907943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-53459910-0c51-49c3-ae75-3b078f1f4238 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:05.908379 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-53459910-0c51-49c3-ae75-3b078f1f4238 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:06.053635 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-53459910-0c51-49c3-ae75-3b078f1f4238 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:06.061678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-53459910-0c51-49c3-ae75-3b078f1f4238 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1673 microversion: 2.1 time: 0.168352 Jun 22 11:56:06.062318 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 426/901] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:56:05 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:56:06.626006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:06.626617 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:06.633113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:06.633583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:06.634345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:06.634783 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:06.766372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:06.774215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:06.775735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:06.776872 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fb7993c8-9053-4abe-ae95-8513cdb045c4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.154794 Jun 22 11:56:06.777429 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 476/902] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:06 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:07.083762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-34bf52eb-bd2b-4896-b27b-a49454755487 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:07.084541 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-34bf52eb-bd2b-4896-b27b-a49454755487 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:07.091655 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-34bf52eb-bd2b-4896-b27b-a49454755487 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:07.092206 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-34bf52eb-bd2b-4896-b27b-a49454755487 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:07.093101 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-34bf52eb-bd2b-4896-b27b-a49454755487 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:07.093647 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-34bf52eb-bd2b-4896-b27b-a49454755487 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:07.227994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-34bf52eb-bd2b-4896-b27b-a49454755487 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:07.236607 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-34bf52eb-bd2b-4896-b27b-a49454755487 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1673 microversion: 2.1 time: 0.156469 Jun 22 11:56:07.237264 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 427/903] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:56:07 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:56:07.794818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:07.795382 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:07.801703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:07.802150 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:07.802906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:07.803333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:07.953035 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:07.961486 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:07.963104 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:07.964359 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f1a7dafc-94bb-4cc3-bf54-14d8a96061ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.173747 Jun 22 11:56:07.964908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 477/904] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:07 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:08.147585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-13c14b1a-adf8-4102-86bd-75a18a33b9b8 req-d97751bd-11ba-4ffd-ae0e-1a95cf2ba5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c949fdfd-21bc-4762-9e00-db7937f32e69", "name": "network-vif-deleted", "tag": "162c3a1d-7840-4496-a4db-751b8245d273"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:56:08.159220 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-13c14b1a-adf8-4102-86bd-75a18a33b9b8 req-d97751bd-11ba-4ffd-ae0e-1a95cf2ba5c4 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:08.159602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-13c14b1a-adf8-4102-86bd-75a18a33b9b8 req-d97751bd-11ba-4ffd-ae0e-1a95cf2ba5c4 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:08.173123 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-13c14b1a-adf8-4102-86bd-75a18a33b9b8 req-d97751bd-11ba-4ffd-ae0e-1a95cf2ba5c4 service nova] Creating event network-vif-deleted:162c3a1d-7840-4496-a4db-751b8245d273 for instance c949fdfd-21bc-4762-9e00-db7937f32e69 on hv-cinder-83697 Jun 22 11:56:08.179993 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-13c14b1a-adf8-4102-86bd-75a18a33b9b8 req-d97751bd-11ba-4ffd-ae0e-1a95cf2ba5c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037190 Jun 22 11:56:08.181331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 428/905] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:08.557051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:08.557651 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:08.563639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:08.564079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:08.564837 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:08.565259 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:08.597434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:08.597870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:08.598316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lazy-loading 'fault' on Instance uuid c949fdfd-21bc-4762-9e00-db7937f32e69 {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 11:56:08.649843 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7c1adbb2ad456eaf5793a15d6fcb4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878b71f291ec4107a09e3109b6acc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:08.658091 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d4eb92a2-ca15-41ee-97d6-c2382c5d7690 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 200 len: 1328 microversion: 2.1 time: 0.407655 Jun 22 11:56:08.658905 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 478/906] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:56:08 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 1328 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:56:08.983157 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:08.984417 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:08.990576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:08.991014 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:08.991818 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:08.992247 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:09.127416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:09.136404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:09.137910 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:09.139323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-67d9ec5b-f1c9-414a-a52d-fd4d77f463f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1743 microversion: 2.20 time: 0.160279 Jun 22 11:56:09.139903 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 429/907] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:08 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:09.675521 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:09.676122 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:09.683175 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:09.683648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:09.684406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:09.684836 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:09.698091 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] HTTP exception thrown: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Request method failure captured: Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 HTTP/1.1 Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDNMSQMDiSmxCN4-CiUM371W5wtLjYPqgv_H9i7sLRWyN-mcFoeJIlt9wYicdbN2I7AsZDno8rwgh7MwSqkehthIGECk2230M1pEekyMsI_68eO0yhZpOIIgWQ67bpNl6ZsLhgrriqI971XCzjcW_QihdCPc3U62fZBxGTYjHzb3SU Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:56:09.699757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_878b71f291ec4107a09e3109b6acc40b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 4d7c1adbb2ad456eaf5793a15d6fcb4b Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:09.701538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'c949fdfd-21bc-4762-9e00-db7937f32e69'} Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:56:09.702612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:09.704236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:09.705883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Returning 404 to user: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:56:09.705883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-10808423-e243-49ed-9e20-d565bc8b4189 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 404 len: 111 microversion: 2.1 time: 0.029510 Jun 22 11:56:09.705883 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 479/908] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:56:09 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:56:09.709925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-cebfdff8-98aa-4d05-8aa6-cfa87c04510c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '.version_select at 0x7f3ea81f8a60>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:09.728052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-cebfdff8-98aa-4d05-8aa6-cfa87c04510c tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630001352" status: 202 len: 0 microversion: 2.1 time: 0.021332 Jun 22 11:56:09.728602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 430/909] 10.222.0.36 () {58 vars in 1220 bytes} [Wed Jun 22 11:56:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630001352 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 11:56:10.162483 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:10.168637 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:10.175034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:10.175518 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:10.176290 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:10.176721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:10.313516 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:10.322134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:10.323657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:10.324811 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3404820c-f906-4b22-829e-601249f1b249 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1743 microversion: 2.20 time: 0.166606 Jun 22 11:56:10.325397 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 480/910] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:10 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:11.343150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:11.343771 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:11.351604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:11.353002 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:11.353334 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:11.353762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:11.488972 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:11.497102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:11.498576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:11.499746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-24078364-47b1-4e77-aa6e-27ee6063c355 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1743 microversion: 2.20 time: 0.160537 Jun 22 11:56:11.500295 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 431/911] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:11 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:12.101975 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-7a109cf0-b5fd-451e-863f-928020a97cd6 req-05f4cdbf-84e0-4892-b676-2202fb3df0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f26d8d-a0e4-4c9a-bf16-88ec416eba46", "name": "network-vif-plugged", "status": "completed", "tag": "8c843eaa-9d2f-4212-b0db-0d0350968b30"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:56:12.110091 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-7a109cf0-b5fd-451e-863f-928020a97cd6 req-05f4cdbf-84e0-4892-b676-2202fb3df0da service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:12.110511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-7a109cf0-b5fd-451e-863f-928020a97cd6 req-05f4cdbf-84e0-4892-b676-2202fb3df0da service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:12.121980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-7a109cf0-b5fd-451e-863f-928020a97cd6 req-05f4cdbf-84e0-4892-b676-2202fb3df0da service nova] Creating event network-vif-plugged:8c843eaa-9d2f-4212-b0db-0d0350968b30 for instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 on hv-cinder-83697 Jun 22 11:56:12.126958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-7a109cf0-b5fd-451e-863f-928020a97cd6 req-05f4cdbf-84e0-4892-b676-2202fb3df0da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094343 Jun 22 11:56:12.127679 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 481/912] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:12.517819 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:12.518470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:12.525389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:12.525830 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:12.526580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:12.527305 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:12.661987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:12.670411 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:12.671930 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:12.673085 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-df5e21dd-ecc5-4841-b2d1-25de862c651b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1743 microversion: 2.20 time: 0.159515 Jun 22 11:56:12.673684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 432/913] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:12 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:12.855912 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:12.856496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:12.862547 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:12.862992 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:12.863775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:12.864204 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:12.877083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] HTTP exception thrown: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Request method failure captured: Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 HTTP/1.1 Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDNMSQMDiSmxCN4-CiUM371W5wtLjYPqgv_H9i7sLRWyN-mcFoeJIlt9wYicdbN2I7AsZDno8rwgh7MwSqkehthIGECk2230M1pEekyMsI_68eO0yhZpOIIgWQ67bpNl6ZsLhgrriqI971XCzjcW_QihdCPc3U62fZBxGTYjHzb3SU Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:56:12.878696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_878b71f291ec4107a09e3109b6acc40b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 4d7c1adbb2ad456eaf5793a15d6fcb4b Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.880287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'c949fdfd-21bc-4762-9e00-db7937f32e69'} Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:56:12.881109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.882338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.883655 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Returning 404 to user: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:56:12.883655 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3bd8b7bd-f9b4-4795-b3ab-e163d22fcec4 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 404 len: 111 microversion: 2.1 time: 0.028998 Jun 22 11:56:12.883655 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 482/914] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:56:12 2022] DELETE /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:56:12.888670 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:12.889571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: c949fdfd-21bc-4762-9e00-db7937f32e69] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:12.895630 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:12.896079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:12.896837 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:12.897274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:12.912813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] HTTP exception thrown: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Request method failure captured: Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 HTTP/1.1 Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswDNMSQMDiSmxCN4-CiUM371W5wtLjYPqgv_H9i7sLRWyN-mcFoeJIlt9wYicdbN2I7AsZDno8rwgh7MwSqkehthIGECk2230M1pEekyMsI_68eO0yhZpOIIgWQ67bpNl6ZsLhgrriqI971XCzjcW_QihdCPc3U62fZBxGTYjHzb3SU Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:56:12.914426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_878b71f291ec4107a09e3109b6acc40b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 4d7c1adbb2ad456eaf5793a15d6fcb4b Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.916597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'c949fdfd-21bc-4762-9e00-db7937f32e69'} Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:56:12.917535 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. Jun 22 11:56:12.919031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:12.920592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Returning 404 to user: Instance c949fdfd-21bc-4762-9e00-db7937f32e69 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:56:12.920592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e823151c-60c2-42da-a322-f5ba9df93f82 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69" status: 404 len: 111 microversion: 2.1 time: 0.031012 Jun 22 11:56:12.920592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 433/915] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:56:12 2022] GET /compute/v2.1/servers/c949fdfd-21bc-4762-9e00-db7937f32e69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:56:13.691786 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:13.692409 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:13.699682 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:13.700128 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:13.700906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:13.701338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:13.829716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:13.837592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:13.839097 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:13.840266 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bec14ffc-8470-431d-8d9c-055422b07508 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1743 microversion: 2.20 time: 0.152330 Jun 22 11:56:13.840821 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 483/916] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:13 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:14.051022 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:14.051537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:14.058293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:14.058741 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:14.059539 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:14.059979 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:14.073124 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] HTTP exception thrown: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Request method failure captured: Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 HTTP/1.1 Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswDNMSQMDiSmxCN4-CiUM371W5wtLjYPqgv_H9i7sLRWyN-mcFoeJIlt9wYicdbN2I7AsZDno8rwgh7MwSqkehthIGECk2230M1pEekyMsI_68eO0yhZpOIIgWQ67bpNl6ZsLhgrriqI971XCzjcW_QihdCPc3U62fZBxGTYjHzb3SU Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:56:14.074684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_878b71f291ec4107a09e3109b6acc40b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 4d7c1adbb2ad456eaf5793a15d6fcb4b Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.076232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'af6ebc0a-848b-4688-939a-062ccc6dc352'} Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:56:14.077250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.078700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.080252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Returning 404 to user: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:56:14.080252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b60e5374-eb4a-4d96-908a-57f58efd4e56 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 404 len: 111 microversion: 2.1 time: 0.029042 Jun 22 11:56:14.080252 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 434/917] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:56:14 2022] DELETE /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:56:14.084428 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:14.085033 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] [instance: af6ebc0a-848b-4688-939a-062ccc6dc352] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:14.091482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:14.091923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:14.092669 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:14.093094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:14.109056 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] HTTP exception thrown: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Request method failure captured: Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 HTTP/1.1 Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswDNMSQMDiSmxCN4-CiUM371W5wtLjYPqgv_H9i7sLRWyN-mcFoeJIlt9wYicdbN2I7AsZDno8rwgh7MwSqkehthIGECk2230M1pEekyMsI_68eO0yhZpOIIgWQ67bpNl6ZsLhgrriqI971XCzjcW_QihdCPc3U62fZBxGTYjHzb3SU Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:56:14.110523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_878b71f291ec4107a09e3109b6acc40b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/878b71f291ec4107a09e3109b6acc40b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 878b71f291ec4107a09e3109b6acc40b Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1768011517 Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 4d7c1adbb2ad456eaf5793a15d6fcb4b Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeTestJSON-1768011517-project Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.112649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'af6ebc0a-848b-4688-939a-062ccc6dc352'} Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:56:14.113945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. Jun 22 11:56:14.115446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:56:14.117370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] Returning 404 to user: Instance af6ebc0a-848b-4688-939a-062ccc6dc352 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:56:14.117370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-da0bef5e-c108-4fb3-af8b-dd0c987be8d9 tempest-AttachVolumeTestJSON-1768011517 tempest-AttachVolumeTestJSON-1768011517-project] 10.222.0.36 "GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352" status: 404 len: 111 microversion: 2.1 time: 0.031391 Jun 22 11:56:14.117370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 484/918] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:56:14 2022] GET /compute/v2.1/servers/af6ebc0a-848b-4688-939a-062ccc6dc352 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 11:56:14.858069 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:14.858736 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:14.864808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:14.865256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:14.866067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:14.866437 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:15.000735 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:15.010451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:15.012167 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:15.013449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-acd947c3-8468-4f64-bf68-3d11d1288122 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1743 microversion: 2.20 time: 0.159280 Jun 22 11:56:15.014001 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 435/919] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:14 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:16.035031 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:16.037078 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:16.049403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:16.049968 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:16.050881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:16.051514 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:16.216255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:16.228794 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:16.231823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:16.233225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6c43bb8b-5302-4058-831b-387f3fdafa5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.204573 Jun 22 11:56:16.234250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 485/920] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:16 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:17.257941 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:17.259133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:17.269528 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:56:17.275593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:17.279515 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:17.281404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:17.282478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:17.671838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:17.682369 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:17.684334 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:17.685587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bd4686c7-e32a-48c7-9dff-247c31ac1f5c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.437059 Jun 22 11:56:17.697102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 436/921] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:17 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:18.705792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:18.706554 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:18.723881 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:56:18.745219 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:18.746949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:18.748074 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:18.753120 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:18.918282 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:18.932023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:18.934411 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:18.936117 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d8ee2e66-b64d-475e-b586-14f3aef9ab7b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.235915 Jun 22 11:56:18.937215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 486/922] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:18 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:19.956261 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:19.957520 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:19.965475 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:19.966123 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:19.967121 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:19.967597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:20.121262 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:20.129558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:20.131497 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:20.132847 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-57a82ec2-c84e-4099-b3c3-5b8ebf5f18fb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.181336 Jun 22 11:56:20.133560 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 437/923] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:19 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:20.565715 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ad8bb02d-3a9c-4ef6-b3ad-f2c628723217 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea80461f0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:20.619626 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ad8bb02d-3a9c-4ef6-b3ad-f2c628723217 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/bab6fa17-047e-4401-afa7-aeb760ca0bfa" status: 200 len: 350 microversion: 2.1 time: 0.057746 Jun 22 11:56:20.620239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 487/924] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:56:20 2022] GET /compute/v2.1/os-volumes/bab6fa17-047e-4401-afa7-aeb760ca0bfa => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:21.161846 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:21.162867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:21.173022 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:21.173536 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:21.174795 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:21.176117 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:21.342293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:21.350642 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:21.352166 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:21.353363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-451eafd0-8468-4212-8471-7f008d7f7b5b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.203538 Jun 22 11:56:21.353915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 438/925] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:21 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:22.048965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f20e3a9b-502d-4bfa-8f8c-94a673a919d6 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea822b940>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:22.104600 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f20e3a9b-502d-4bfa-8f8c-94a673a919d6 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e024736a-2656-4b56-b9e2-add24c5e5c15" status: 200 len: 350 microversion: 2.1 time: 0.059772 Jun 22 11:56:22.105160 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 488/926] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:56:22 2022] GET /compute/v2.1/os-volumes/e024736a-2656-4b56-b9e2-add24c5e5c15 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:22.380524 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:22.381842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:22.390272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:22.391055 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:22.392441 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:22.393271 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:22.562817 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:22.570845 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:22.572991 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:22.574150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-25ebb8e9-d6aa-40c0-a79a-8448041924ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.197794 Jun 22 11:56:22.574702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 439/927] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:22 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:23.540726 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5244eb53-7be5-4e84-ba8d-13dfe9d45894 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea80778b0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:23.595376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:23.596461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5244eb53-7be5-4e84-ba8d-13dfe9d45894 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/47bfd32c-4733-41fe-a98c-360f68eeda37" status: 200 len: 350 microversion: 2.1 time: 0.062301 Jun 22 11:56:23.597552 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 489/928] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 11:56:23 2022] GET /compute/v2.1/os-volumes/47bfd32c-4733-41fe-a98c-360f68eeda37 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:23.597759 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:23.605354 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:23.606067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:23.607050 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:23.607743 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:23.613364 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-50d7bf1d-67f1-4e9f-9380-d3f33b174a61 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea81d1dc0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:23.727832 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-50d7bf1d-67f1-4e9f-9380-d3f33b174a61 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.119926 Jun 22 11:56:23.728769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 490/929] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Jun 22 11:56:23 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:56:23.747414 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e57e520c-619c-44ba-a083-4c71ff5dce61 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea81f8160>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:23.797497 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:23.805761 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:23.807986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:23.809479 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c06af3eb-83a3-4524-9979-7cab76c71e5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.218265 Jun 22 11:56:23.810592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 440/930] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:23 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:23.836800 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e57e520c-619c-44ba-a083-4c71ff5dce61 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095566 Jun 22 11:56:23.837366 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 491/931] 10.222.0.36 () {58 vars in 1148 bytes} [Wed Jun 22 11:56:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:23.852987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4a29912a-4f5c-4449-abe0-ef8411cd9623 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea82baf70>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:23.943073 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4a29912a-4f5c-4449-abe0-ef8411cd9623 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.093519 Jun 22 11:56:23.943073 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 441/932] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Jun 22 11:56:23 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:56:23.956108 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cd0fb018-5a80-43f2-a540-891af773d92b tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea8077430>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:24.040467 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cd0fb018-5a80-43f2-a540-891af773d92b tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089665 Jun 22 11:56:24.041598 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 492/933] 10.222.0.36 () {58 vars in 1166 bytes} [Wed Jun 22 11:56:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 11:56:24.053909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-731e1c78-2ab3-412b-a14b-bfbad35ad63b tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea80c0820>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:24.142459 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-731e1c78-2ab3-412b-a14b-bfbad35ad63b tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.092485 Jun 22 11:56:24.152564 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 442/934] 10.222.0.36 () {58 vars in 1169 bytes} [Wed Jun 22 11:56:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:24.160355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5e795e47-bc6b-49ec-8b2e-52167423eecd tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea80b5790>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:24.267006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5e795e47-bc6b-49ec-8b2e-52167423eecd tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.113417 Jun 22 11:56:24.267623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 493/935] 10.222.0.36 () {58 vars in 1154 bytes} [Wed Jun 22 11:56:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:56:24.278990 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-91285829-9b0f-4a98-a98c-c96bfbee83b9 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea8207310>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:24.367687 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-91285829-9b0f-4a98-a98c-c96bfbee83b9 tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092430 Jun 22 11:56:24.368426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 443/936] 10.222.0.36 () {58 vars in 1187 bytes} [Wed Jun 22 11:56:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:24.381017 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ca022376-8c8f-4372-85ea-70ae5b217d4c tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] Calling method '.version_select at 0x7f3ea822bdc0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:24.466419 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ca022376-8c8f-4372-85ea-70ae5b217d4c tempest-VolumesTestJSON-819218793 tempest-VolumesTestJSON-819218793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089104 Jun 22 11:56:24.479116 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 494/937] 10.222.0.36 () {58 vars in 1154 bytes} [Wed Jun 22 11:56:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:56:24.829514 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:24.830256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:24.836937 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:24.837801 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:24.838936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:24.839581 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:24.984892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:24.997350 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:24.999148 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:25.001254 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1a566901-718f-40b0-9db3-ce9828265dc5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.175601 Jun 22 11:56:25.015207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 444/938] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:24 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:26.023649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:26.024263 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:26.033238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:26.034019 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:26.035194 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:26.035889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:26.234901 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:26.247619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:26.250398 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:26.252090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c5079b87-3570-4184-8c78-be292eff9e3b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.233035 Jun 22 11:56:26.252652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 495/939] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:26 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:27.271943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:27.272558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:27.283665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:27.284118 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:27.284908 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:27.285434 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:27.448222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:27.456248 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:27.458110 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:27.459378 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-430a86b6-4a49-447d-a1da-066ad0acc44a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.191733 Jun 22 11:56:27.459943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 445/940] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:27 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:28.486071 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:28.486800 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:28.493274 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:28.493720 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:28.494543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:28.494985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:28.631760 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:28.641124 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:28.642660 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:28.643939 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0a5bab92-21eb-4271-8538-5a2f87fdce7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1738 microversion: 2.20 time: 0.161757 Jun 22 11:56:28.644423 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 496/941] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:28 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:29.662443 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:29.663144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:29.670828 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:29.671157 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:29.672534 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:29.672964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:29.822573 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:29.831483 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:29.833224 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:29.834488 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2b293ad3-8482-41d2-a16a-666f2fb3d986 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1720 microversion: 2.20 time: 0.176018 Jun 22 11:56:29.835102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 446/942] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:29 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:30.853696 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:30.854344 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:30.860902 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:30.861355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:30.862113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:30.862549 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:30.996402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:31.005016 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:31.006517 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:31.007686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c5a9829b-4921-4839-afe2-d9b4737d0a74 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1720 microversion: 2.20 time: 0.157847 Jun 22 11:56:31.008245 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 497/943] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:30 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:32.026536 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:32.027237 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:32.034275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:32.034785 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:32.035637 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:32.036133 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:32.186107 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:32.194426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:32.196021 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:32.197177 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-31ea1c67-ab45-4644-891e-bb5d101f12c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1723 microversion: 2.20 time: 0.174538 Jun 22 11:56:32.197797 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 447/944] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:32 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:32.225184 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4c63f09a-9d65-4a97-b888-b44ea963b4ef tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c1f5c7a-23b1-4eb7-9df1-4cea027bc3d9"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:56:32.226179 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4c63f09a-9d65-4a97-b888-b44ea963b4ef tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:32.233279 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4c63f09a-9d65-4a97-b888-b44ea963b4ef tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:32.233733 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4c63f09a-9d65-4a97-b888-b44ea963b4ef tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:32.234704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4c63f09a-9d65-4a97-b888-b44ea963b4ef tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:32.235148 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4c63f09a-9d65-4a97-b888-b44ea963b4ef tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:32.525829 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:56:32.537191 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4c63f09a-9d65-4a97-b888-b44ea963b4ef tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318568 Jun 22 11:56:32.538223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 498/945] 10.222.0.36 () {62 vars in 1363 bytes} [Wed Jun 22 11:56:32 2022] POST /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 11:56:32.655372 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a250c332-5d47-45ce-9a84-b86338f53a47 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:32.655921 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a250c332-5d47-45ce-9a84-b86338f53a47 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:32.662075 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a250c332-5d47-45ce-9a84-b86338f53a47 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:32.662826 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a250c332-5d47-45ce-9a84-b86338f53a47 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:32.663762 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a250c332-5d47-45ce-9a84-b86338f53a47 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:32.664195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a250c332-5d47-45ce-9a84-b86338f53a47 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:32.688427 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:56:32.970012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a250c332-5d47-45ce-9a84-b86338f53a47 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/os-volume_attachments/4c1f5c7a-23b1-4eb7-9df1-4cea027bc3d9" status: 202 len: 0 microversion: 2.20 time: 0.319025 Jun 22 11:56:32.970598 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 448/946] 10.222.0.36 () {60 vars in 1456 bytes} [Wed Jun 22 11:56:32 2022] DELETE /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/os-volume_attachments/4c1f5c7a-23b1-4eb7-9df1-4cea027bc3d9 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:56:33.029014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cc2e44d5-e721-45e8-8f19-15fd25926912 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:56:33.029459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cc2e44d5-e721-45e8-8f19-15fd25926912 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:33.035968 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc2e44d5-e721-45e8-8f19-15fd25926912 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:33.036406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc2e44d5-e721-45e8-8f19-15fd25926912 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:33.037165 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc2e44d5-e721-45e8-8f19-15fd25926912 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:33.037612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cc2e44d5-e721-45e8-8f19-15fd25926912 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:33.137517 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cc2e44d5-e721-45e8-8f19-15fd25926912 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "POST /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/action" status: 202 len: 0 microversion: 2.20 time: 0.113137 Jun 22 11:56:33.138541 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 499/947] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Jun 22 11:56:33 2022] POST /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:56:33.146818 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:33.148011 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:33.155259 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:33.156058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:33.157021 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:33.157371 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:33.344360 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:33.355970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:33.358223 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:33.359574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2be10b3e-4e03-4726-856a-9cee6f12082e tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1671 microversion: 2.20 time: 0.216617 Jun 22 11:56:33.371015 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 449/948] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:33 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1671 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:34.359258 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-e947741c-d81d-471e-bf1b-568bef9cd0ba req-123c78ed-df7c-43ed-9605-2e128ffc883c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f26d8d-a0e4-4c9a-bf16-88ec416eba46", "name": "network-vif-unplugged", "status": "completed", "tag": "8c843eaa-9d2f-4212-b0db-0d0350968b30"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:56:34.368151 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-e947741c-d81d-471e-bf1b-568bef9cd0ba req-123c78ed-df7c-43ed-9605-2e128ffc883c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:34.368676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-e947741c-d81d-471e-bf1b-568bef9cd0ba req-123c78ed-df7c-43ed-9605-2e128ffc883c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:34.381714 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:34.382307 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:34.386331 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-e947741c-d81d-471e-bf1b-568bef9cd0ba req-123c78ed-df7c-43ed-9605-2e128ffc883c service nova] Creating event network-vif-unplugged:8c843eaa-9d2f-4212-b0db-0d0350968b30 for instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 on hv-cinder-83697 Jun 22 11:56:34.391558 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:34.392424 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:34.394100 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:34.394778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:34.395908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-e947741c-d81d-471e-bf1b-568bef9cd0ba req-123c78ed-df7c-43ed-9605-2e128ffc883c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040689 Jun 22 11:56:34.397531 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 500/949] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:56:34.548103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:34.556200 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:34.557737 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:34.558895 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c81fb8fb-ab89-411e-a7d9-3c5c9f2b5f5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.183264 Jun 22 11:56:34.559480 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 450/950] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:34 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:56:35.584243 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:35.586233 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:35.595086 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:35.595652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:35.596573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:35.597092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:35.778569 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:35.788407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:35.790129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:35.791312 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8b5c96c6-4dbb-4d36-98ad-9747075769a6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.214505 Jun 22 11:56:35.791954 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 501/951] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:35 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:36.813686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:36.814239 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:36.826260 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:36.829383 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:36.831609 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:36.835854 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:37.055818 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:37.077114 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:37.079186 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:37.080623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-42374cc1-eef4-4930-8c60-25196c593772 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.274076 Jun 22 11:56:37.081760 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 451/952] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:36 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:38.100475 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:38.101061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:38.107853 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:38.108314 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:38.109236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:38.109666 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:38.278098 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:38.290306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:38.293206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:38.295311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-29c42c96-65dd-4800-9de0-bff54a036f2c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.198467 Jun 22 11:56:38.299404 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 502/953] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:38 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:39.317623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:39.318222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:39.325323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:39.326088 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:39.326939 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:39.327399 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:39.480304 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:39.489912 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:39.491810 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:39.493101 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e3282baa-181a-4ec1-aeac-b33622c23cab tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.179374 Jun 22 11:56:39.493667 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 452/954] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:39 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:40.512665 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:40.513370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:40.521593 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:40.522202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:40.523094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:40.523756 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:40.660636 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:40.669291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:40.670908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:40.672257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f92041e7-7960-41d3-ba77-99c776a039f3 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.164783 Jun 22 11:56:40.672820 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 503/955] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:40 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:41.690643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:41.691250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:41.697800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:41.698292 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:41.699583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:41.700017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:41.832313 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:41.840707 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:41.842247 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:41.843425 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-95389442-7b00-471f-967d-ac8d8ae2c4ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.156734 Jun 22 11:56:41.843990 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 453/956] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:41 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:42.862133 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:42.862721 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:42.869339 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:42.869784 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:42.871041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:42.871499 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:43.000367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:43.008148 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:43.009645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:43.011448 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-65ae2ce9-2aba-4a8c-a542-b6f8f727fb99 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.152719 Jun 22 11:56:43.012014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 504/957] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:42 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:44.030695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:44.031301 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:44.037734 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:44.038188 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:44.038958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:44.039416 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:44.179392 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:44.189623 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:44.191227 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:44.192389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4402a6a9-f6a1-47e5-b7a1-8afb4c4e596f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.166441 Jun 22 11:56:44.200115 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 454/958] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:44 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:45.211446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:45.212667 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:45.219870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:45.220320 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:45.221125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:45.221564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:45.359389 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:45.367126 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:45.368634 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:45.369759 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9a0a949d-349c-4809-99dc-0a9ca8763bc4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.162329 Jun 22 11:56:45.370338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 505/959] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:45 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:46.387952 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:46.388585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:46.395489 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:46.395926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:46.396684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:46.397110 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:46.535718 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:46.544122 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:46.545624 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:46.546778 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-caae5c24-0c56-46c1-a9fe-300d9beec3c6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.162674 Jun 22 11:56:46.547331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 455/960] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:46 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:47.565215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:47.565798 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:47.572624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:47.573062 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:47.573824 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:47.574247 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:47.702617 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:47.710398 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:47.712094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:47.713219 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-92713576-d548-45d9-9c8d-49213875dca7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.152030 Jun 22 11:56:47.713766 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 506/961] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:47 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:48.732661 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:48.733246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:48.735980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=34 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:56:48.741581 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:48.742021 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:48.742772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:48.743199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:48.873978 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:48.881768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:48.883257 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:48.884420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-249faf3a-3bd3-4305-aeff-e0de62bf29c9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.156323 Jun 22 11:56:48.884971 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 456/962] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:48 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:49.902828 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:49.903523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:49.905948 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=28 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:56:49.911317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:49.911788 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:49.912550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:49.912984 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:50.050829 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:50.059763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:50.061255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:50.062395 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cf23275d-c5cd-4a5b-9576-3a637e3ec45f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.163403 Jun 22 11:56:50.062950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 507/963] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:49 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:51.080739 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:51.081340 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:51.087954 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:51.088377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:51.089632 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:51.090057 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:51.217636 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:51.225511 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:51.226983 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:51.228147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d9949252-aa27-4026-a1c6-a5ad3d74ee5f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.151475 Jun 22 11:56:51.228705 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 457/964] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:51 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:52.247779 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:52.248303 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:52.254924 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:52.255397 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:52.256202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:52.256586 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:52.394284 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:52.402183 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:52.403720 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:52.404855 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-12b7508f-0eba-43c2-9164-059338a198ba tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.161756 Jun 22 11:56:52.405409 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 508/965] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:52 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:53.423672 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:53.424306 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:53.430727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:53.431166 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:53.431975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:53.432404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:53.563953 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:53.571877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:53.573367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:53.575198 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-710fb9fc-4c36-4391-9aee-4749ee00c20b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.155390 Jun 22 11:56:53.575810 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 458/966] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:53 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:54.593890 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:54.594520 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:54.601284 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:54.601847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:54.602713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:54.603143 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:54.731618 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:54.739779 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:54.741258 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:54.742381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1178f122-be86-43f2-a1dd-7b45153cfd25 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.152830 Jun 22 11:56:54.742938 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 509/967] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:54 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:55.761695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:55.762286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:55.769168 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:55.769758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:55.770587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:55.770964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:55.898993 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:55.906982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:55.908500 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:55.909641 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2f9aec6b-e558-4d30-80f1-1394c628b93b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.152493 Jun 22 11:56:55.910193 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 459/968] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:55 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:56.928478 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:56.929116 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:56.936687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:56.937135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:56.938032 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:56.938470 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:57.073140 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:57.081588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:57.083079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:57.084243 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c7b0d3ff-7b4c-49eb-9a64-303f0d719e56 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.159798 Jun 22 11:56:57.084797 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 510/969] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:56 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 11:56:58.103376 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:58.103975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:58.111021 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:58.111497 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:58.112249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:58.112670 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:58.246524 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:58.254335 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:58.255925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:58.257063 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6e7ca4ec-dacf-4a54-ad36-ac4246314082 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.157624 Jun 22 11:56:58.257602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 460/970] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:58 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:56:59.276438 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:56:59.276996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:56:59.283375 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:59.283826 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:59.284581 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:56:59.285003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:56:59.413489 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:59.422085 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:59.424453 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:56:59.426553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-08c13e39-dd5b-4620-883c-66ce0fa1f58a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.153903 Jun 22 11:56:59.427587 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 511/971] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:56:59 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:00.445861 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:00.446462 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:00.453470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:00.453912 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:00.454674 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:00.455101 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:00.596386 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:00.604323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:00.605859 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:00.607629 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-dfb02084-632f-49b7-9b0e-2f4d554f5383 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.165144 Jun 22 11:57:00.607629 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 461/972] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:00 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:01.625401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:01.625959 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:01.632488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:01.632928 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:01.633686 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:01.634111 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:01.767761 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:01.776358 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:01.778429 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:01.779612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d4a36548-1d7f-4421-bfa8-fd629fb10a16 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.158154 Jun 22 11:57:01.780162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 512/973] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:01 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:02.798825 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:02.799505 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:02.806512 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:02.806917 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:02.807727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:02.808786 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:02.811594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:57:02.947680 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:02.955880 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:02.957363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:02.958540 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7f54e9c3-2be6-462e-9c4f-dabf1ee924db tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.164141 Jun 22 11:57:02.959084 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 462/974] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:02 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:03.976991 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:03.977585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:03.984087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:03.984523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:03.985333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:03.985767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:03.988307 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:57:04.262093 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:04.270228 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:04.271751 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:04.272894 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-44511155-4f5a-43e5-97a5-d33f06bf61a9 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.299787 Jun 22 11:57:04.273454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 513/975] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:03 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:05.291782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:05.293040 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:05.299556 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:05.299999 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:05.300766 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:05.301195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:05.431007 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:05.439609 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:05.441120 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:05.442284 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-88126cef-9b75-477a-9568-6f504ec7ec17 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.154480 Jun 22 11:57:05.442843 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 463/976] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:05 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:06.468672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:06.469273 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:06.475624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:06.476070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:06.476825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:06.477253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:06.616768 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:06.625547 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:06.627041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:06.628201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-90c72b89-615e-4595-af2e-201c5a712d7f tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.164034 Jun 22 11:57:06.628753 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 514/977] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:06 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:07.646938 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:07.647567 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:07.654495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:07.654932 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:07.655720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:07.656142 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:07.789491 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:07.797755 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:07.799250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:07.800469 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8e0b1105-b761-40ea-9e16-92d6c5947f62 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.157442 Jun 22 11:57:07.801020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 464/978] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:07 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:08.818781 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:08.819395 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:08.825847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:08.826286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:08.827028 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:08.827491 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:08.969087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:08.977355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:08.978983 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:08.980827 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bc44e0aa-aff8-4a08-8553-25dde436201d tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.165916 Jun 22 11:57:08.981382 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 515/979] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:08 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:09.998597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:09.999067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:10.005621 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:10.006068 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:10.006837 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:10.007271 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:10.137250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:10.145487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:10.146965 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:10.148132 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d3fd4203-1983-47b3-9ed6-f638549246b6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.154174 Jun 22 11:57:10.148676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 465/980] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:09 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:11.165948 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:11.166571 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:11.173678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:11.174119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:11.174878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:11.175305 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:11.306732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:11.315567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:11.317052 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:11.318200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4b9e3484-5da8-42fe-9f71-04892f8193f6 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.156195 Jun 22 11:57:11.318755 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 516/981] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:11 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:12.336867 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:12.337469 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:12.344996 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:12.345436 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:12.346188 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:12.346617 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:12.487678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:12.497389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:12.499089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:12.500354 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f280f54d-cb43-4838-a406-774bc2e836c8 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.167660 Jun 22 11:57:12.501344 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 466/982] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:12 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:13.522004 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:13.522609 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:13.529781 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:13.530236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:13.530995 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:13.531445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:13.661705 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:13.670371 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:13.671956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:13.673074 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3fbc2471-8501-43b3-8281-23c9cdf55132 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.155246 Jun 22 11:57:13.673627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 517/983] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:13 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:14.693554 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:14.694176 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:14.701668 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:14.702110 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:14.703072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:14.703536 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:14.835514 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:14.846943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:14.850676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:14.851861 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-618c78b6-1885-4138-94e6-072dc44b7108 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.163272 Jun 22 11:57:14.852405 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 467/984] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:14 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:15.871179 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:15.871761 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:15.878244 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:15.878687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:15.879471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:15.879896 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:16.012234 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:16.020443 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:16.021965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:16.023115 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-db981a69-1d3d-4504-8084-8ca13653b00b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.156260 Jun 22 11:57:16.023700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 518/985] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:15 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:17.042647 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:17.043261 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:17.049792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:17.050247 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:17.051000 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:17.051462 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:17.183937 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:17.191877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:17.193394 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:17.194555 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-70782ad4-0aa9-4f63-bdcc-c9d0333c089c tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.156381 Jun 22 11:57:17.195120 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 468/986] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:17 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:18.214129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:18.215645 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:18.221564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:18.222095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:18.222936 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:18.223600 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:18.402855 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:18.411660 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:18.413660 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:18.415071 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-68c6b5e8-30de-41a8-8496-a59dc5436592 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.204894 Jun 22 11:57:18.425876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 519/987] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:18 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:19.434084 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:19.434693 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:19.437702 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=26 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:57:19.443326 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:19.444031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:19.444907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:19.445580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:19.585047 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:19.594019 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:19.595930 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:19.597304 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c96d248d-af84-4cd3-ab44-521044578cff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.167528 Jun 22 11:57:19.597866 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 469/988] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:19 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:20.316117 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-d870edd6-506b-4d44-b130-1147862ef399 req-6c0e9faa-3168-45c0-b6d0-23c67628d9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f26d8d-a0e4-4c9a-bf16-88ec416eba46", "name": "network-vif-plugged", "status": "completed", "tag": "8c843eaa-9d2f-4212-b0db-0d0350968b30"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:57:20.323499 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=26 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:57:20.328727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-d870edd6-506b-4d44-b130-1147862ef399 req-6c0e9faa-3168-45c0-b6d0-23c67628d9a2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:20.329265 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-d870edd6-506b-4d44-b130-1147862ef399 req-6c0e9faa-3168-45c0-b6d0-23c67628d9a2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:20.341008 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-d870edd6-506b-4d44-b130-1147862ef399 req-6c0e9faa-3168-45c0-b6d0-23c67628d9a2 service nova] Creating event network-vif-plugged:8c843eaa-9d2f-4212-b0db-0d0350968b30 for instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 on hv-cinder-83697 Jun 22 11:57:20.346548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-d870edd6-506b-4d44-b130-1147862ef399 req-6c0e9faa-3168-45c0-b6d0-23c67628d9a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036710 Jun 22 11:57:20.347214 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 520/989] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:57:20.616708 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:20.617412 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:20.624655 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:20.625187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:20.626030 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:20.626525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:20.761053 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:20.770036 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:20.771628 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:20.772792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0e182295-538f-4b17-adad-d32ea26292ad tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.160184 Jun 22 11:57:20.773364 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 470/990] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:20 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:21.792959 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:21.793732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:21.799857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:21.800301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:21.801143 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:21.801563 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:21.928635 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:21.937684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:21.939226 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:21.940404 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fe0f5764-6843-4849-85e3-38f9ad3eb4b1 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.152342 Jun 22 11:57:21.940949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 521/991] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:21 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:22.958082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:22.958680 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:22.965757 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:22.966197 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:22.966953 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:22.967409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:23.096597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:23.104507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:23.106004 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:23.107183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-48a8c237-e880-4c55-a035-4058186656cb tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.153040 Jun 22 11:57:23.107764 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 471/992] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:22 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:24.125610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:24.126138 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:24.133018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:24.133464 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:24.134230 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:24.134668 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:24.268198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:24.276356 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:24.278535 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:24.279722 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ea59ea22-3cb9-49eb-ad77-e3eed39afbec tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.158119 Jun 22 11:57:24.280277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 522/993] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:24 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:25.298467 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:25.299143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:25.305728 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:25.306199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:25.306961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:25.307489 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:25.452147 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:25.460580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:25.462095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:25.463239 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0230dfc6-0ad0-436a-afa2-1b6ba86fb489 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1729 microversion: 2.20 time: 0.168690 Jun 22 11:57:25.464797 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 472/994] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:25 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:26.482364 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:26.482945 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:26.489462 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:26.489908 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:26.490672 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:26.491100 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:26.621974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:26.630257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:26.631774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:26.632910 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-840f2b84-c77b-4c96-be63-e9b628cac269 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1716 microversion: 2.20 time: 0.154494 Jun 22 11:57:26.633453 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 523/995] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:57:26 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:57:54.579377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8927b6cd-6fd1-4537-b77a-6142c6e869e7 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:54.579980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8927b6cd-6fd1-4537-b77a-6142c6e869e7 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:54.581887 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=7 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:57:54.582521 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=65 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:57:54.588351 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8927b6cd-6fd1-4537-b77a-6142c6e869e7 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:54.588794 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8927b6cd-6fd1-4537-b77a-6142c6e869e7 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:54.589559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8927b6cd-6fd1-4537-b77a-6142c6e869e7 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:54.589983 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8927b6cd-6fd1-4537-b77a-6142c6e869e7 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:54.616788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8927b6cd-6fd1-4537-b77a-6142c6e869e7 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:57:54.694328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8927b6cd-6fd1-4537-b77a-6142c6e869e7 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 204 len: 0 microversion: 2.1 time: 0.118680 Jun 22 11:57:54.694911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 473/996] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 11:57:54 2022] DELETE /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 11:57:54.703178 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-59f2c113-ee22-4cb7-afaf-20023ab3c175 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:54.703902 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-59f2c113-ee22-4cb7-afaf-20023ab3c175 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:54.706157 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=7 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:57:54.706818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=61 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:57:54.712796 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-59f2c113-ee22-4cb7-afaf-20023ab3c175 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:54.713241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-59f2c113-ee22-4cb7-afaf-20023ab3c175 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:54.714000 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-59f2c113-ee22-4cb7-afaf-20023ab3c175 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:54.714426 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-59f2c113-ee22-4cb7-afaf-20023ab3c175 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:54.853002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-59f2c113-ee22-4cb7-afaf-20023ab3c175 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:54.861041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-59f2c113-ee22-4cb7-afaf-20023ab3c175 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1574 microversion: 2.1 time: 0.161747 Jun 22 11:57:54.861599 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 524/997] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:57:54 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:57:55.878222 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8a3569aa-953c-493b-9f1a-4a20e2f05af3 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:55.878963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8a3569aa-953c-493b-9f1a-4a20e2f05af3 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:55.885418 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8a3569aa-953c-493b-9f1a-4a20e2f05af3 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:55.885862 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8a3569aa-953c-493b-9f1a-4a20e2f05af3 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:55.886626 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8a3569aa-953c-493b-9f1a-4a20e2f05af3 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:55.887054 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8a3569aa-953c-493b-9f1a-4a20e2f05af3 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:56.021651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8a3569aa-953c-493b-9f1a-4a20e2f05af3 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:56.029890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8a3569aa-953c-493b-9f1a-4a20e2f05af3 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1574 microversion: 2.1 time: 0.155750 Jun 22 11:57:56.030440 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 474/998] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:57:55 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:57:57.047050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-dc81e9a0-d217-4c82-9093-e5930039d900 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:57.047774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-dc81e9a0-d217-4c82-9093-e5930039d900 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:57.055161 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dc81e9a0-d217-4c82-9093-e5930039d900 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:57.055637 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dc81e9a0-d217-4c82-9093-e5930039d900 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:57.056416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dc81e9a0-d217-4c82-9093-e5930039d900 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:57.056857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-dc81e9a0-d217-4c82-9093-e5930039d900 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:57.212322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-dc81e9a0-d217-4c82-9093-e5930039d900 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:57.219957 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-dc81e9a0-d217-4c82-9093-e5930039d900 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 200 len: 1574 microversion: 2.1 time: 0.176788 Jun 22 11:57:57.220755 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 525/999] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:57:57 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:57:57.417035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-92f67d1e-216d-4a86-b987-41982b59487f req-8b3950a4-84a5-4415-8b58-2a89dd7321cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf7624b-dc26-4c19-91c9-0a2267b82315", "name": "network-vif-deleted", "tag": "5844e5ac-0c8a-465c-b1c6-a814fc67c3d8"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:57:57.427241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-92f67d1e-216d-4a86-b987-41982b59487f req-8b3950a4-84a5-4415-8b58-2a89dd7321cb service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:57.427612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-92f67d1e-216d-4a86-b987-41982b59487f req-8b3950a4-84a5-4415-8b58-2a89dd7321cb service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:57.439451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-92f67d1e-216d-4a86-b987-41982b59487f req-8b3950a4-84a5-4415-8b58-2a89dd7321cb service nova] Creating event network-vif-deleted:5844e5ac-0c8a-465c-b1c6-a814fc67c3d8 for instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 on hv-cinder-83697 Jun 22 11:57:57.444296 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-92f67d1e-216d-4a86-b987-41982b59487f req-8b3950a4-84a5-4415-8b58-2a89dd7321cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031083 Jun 22 11:57:57.444898 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 475/1000] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:57:58.236938 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:58.238217 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:58.244974 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:58.245496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:58.247068 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:58.247568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:58.270446 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] HTTP exception thrown: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Request method failure captured: Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 HTTP/1.1 Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswLMpZYhFMcV2Ro0csyO02NMbyGcafr4oiG36oiZfvorEKCvE5F7E9NPFEALHXA4LFF-5E89-EC2J9B8XmnDilScuSD9zyIxfjytZniTJNKqersR1wbQGJXkMtGR5c0qFtahP5zfDccmh_OvjzPi0E8LjJECmDIobn7OG-Hiv-dFaAI Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:57:58.272215 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_edbd324693e24bcdbf41c207d29d7e2e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-TestVolumeBootPattern-2089758583 Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-TestVolumeBootPattern-2089758583-project Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 239de565f79f474bb21699fd9adc96c4 Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-TestVolumeBootPattern-2089758583-project Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 11:57:58.273971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '8cf7624b-dc26-4c19-91c9-0a2267b82315'} Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:57:58.275061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 11:57:58.276583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:57:58.279639 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Returning 404 to user: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:57:58.280681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e5e62fe8-3d65-4f35-9065-d66022af86fa tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 404 len: 111 microversion: 2.1 time: 0.047564 Jun 22 11:57:58.281153 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 526/1001] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:57:58 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 11:57:58.382617 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2129109636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-979420716", "security_groups": [{"name": "tempest-secgroup-smoke-884704384"}], "block_device_mapping_v2": [{"uuid": "7d37eb09-2952-460c-a578-fc5fabbbf0c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b232377-d4d3-4e90-9c76-2affccfcccc5"}]}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:57:58.508668 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] validate_networks() for [('9b232377-d4d3-4e90-9c76-2affccfcccc5', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:57:58.989929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:57:58.990336 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:57:58.990798 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:57:58.991194 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:57:58.991622 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:57:59.000814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:59.001246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:59.002018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:57:59.002440 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:57:59.019562 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Getting quotas for project edbd324693e24bcdbf41c207d29d7e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:57:59.023333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Getting quotas for user 239de565f79f474bb21699fd9adc96c4 and project edbd324693e24bcdbf41c207d29d7e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:57:59.079777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:57:59.081944 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d37eb09-2952-460c-a578-fc5fabbbf0c1',volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:57:59.211112 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6e7d8679-1feb-45c3-a999-5d7495209527 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.835462 Jun 22 11:57:59.211780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 476/1002] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:57:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:57:59.221742 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-edcbc305-e41d-47c6-bf6a-942c2176ecea tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:57:59.222640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-edcbc305-e41d-47c6-bf6a-942c2176ecea tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:57:59.278830 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-edcbc305-e41d-47c6-bf6a-942c2176ecea tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:57:59.285563 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-edcbc305-e41d-47c6-bf6a-942c2176ecea tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1094 microversion: 2.1 time: 0.067577 Jun 22 11:57:59.286109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 527/1003] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:57:59 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:00.303578 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c512dd78-cdf5-4ae0-88ff-4cd4d5a04843 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:00.304225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c512dd78-cdf5-4ae0-88ff-4cd4d5a04843 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:00.311782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c512dd78-cdf5-4ae0-88ff-4cd4d5a04843 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:00.312296 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c512dd78-cdf5-4ae0-88ff-4cd4d5a04843 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:00.313014 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c512dd78-cdf5-4ae0-88ff-4cd4d5a04843 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:00.313449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c512dd78-cdf5-4ae0-88ff-4cd4d5a04843 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:00.407984 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c512dd78-cdf5-4ae0-88ff-4cd4d5a04843 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:00.415771 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c512dd78-cdf5-4ae0-88ff-4cd4d5a04843 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1210 microversion: 2.1 time: 0.116475 Jun 22 11:58:00.419418 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 477/1004] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:00 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:01.434254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3c90519c-db78-42c2-8b2d-f894c63d5dcd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:01.435510 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3c90519c-db78-42c2-8b2d-f894c63d5dcd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:01.448702 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c90519c-db78-42c2-8b2d-f894c63d5dcd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:01.450017 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c90519c-db78-42c2-8b2d-f894c63d5dcd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:01.451484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c90519c-db78-42c2-8b2d-f894c63d5dcd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:01.452337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3c90519c-db78-42c2-8b2d-f894c63d5dcd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:01.625003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3c90519c-db78-42c2-8b2d-f894c63d5dcd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:01.632769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3c90519c-db78-42c2-8b2d-f894c63d5dcd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.202476 Jun 22 11:58:01.633606 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 528/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:01 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:01.921379 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-ec25991a-468a-4f9e-a53e-341cd345057e req-820f98e8-a9f7-4d9e-b082-b94a575ca78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b514f999-4c83-4dbd-a556-1037c269dcf9", "tag": "015aa5d0-cc6d-4302-9e81-85c44da33007"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:01.941392 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-ec25991a-468a-4f9e-a53e-341cd345057e req-820f98e8-a9f7-4d9e-b082-b94a575ca78b service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:01.942108 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-ec25991a-468a-4f9e-a53e-341cd345057e req-820f98e8-a9f7-4d9e-b082-b94a575ca78b service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:01.960413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-ec25991a-468a-4f9e-a53e-341cd345057e req-820f98e8-a9f7-4d9e-b082-b94a575ca78b service nova] Creating event network-changed:015aa5d0-cc6d-4302-9e81-85c44da33007 for instance b514f999-4c83-4dbd-a556-1037c269dcf9 on hv-cinder-83697 Jun 22 11:58:01.966960 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-ec25991a-468a-4f9e-a53e-341cd345057e req-820f98e8-a9f7-4d9e-b082-b94a575ca78b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052646 Jun 22 11:58:01.967614 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 478/1006] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:58:02.650198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-991b6738-e380-4736-977e-da80f48b7c6b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:02.650806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-991b6738-e380-4736-977e-da80f48b7c6b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:02.657757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-991b6738-e380-4736-977e-da80f48b7c6b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:02.658222 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-991b6738-e380-4736-977e-da80f48b7c6b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:02.658971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-991b6738-e380-4736-977e-da80f48b7c6b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:02.659428 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-991b6738-e380-4736-977e-da80f48b7c6b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:02.787171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-991b6738-e380-4736-977e-da80f48b7c6b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:02.795259 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-991b6738-e380-4736-977e-da80f48b7c6b tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.149013 Jun 22 11:58:02.795843 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 529/1007] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:02 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:03.813441 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7d632f63-543b-4e9d-be4d-4ed78d1e42bd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:03.814154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7d632f63-543b-4e9d-be4d-4ed78d1e42bd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:03.820941 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d632f63-543b-4e9d-be4d-4ed78d1e42bd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:03.821441 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d632f63-543b-4e9d-be4d-4ed78d1e42bd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:03.822134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d632f63-543b-4e9d-be4d-4ed78d1e42bd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:03.822557 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7d632f63-543b-4e9d-be4d-4ed78d1e42bd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:03.959928 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-7d632f63-543b-4e9d-be4d-4ed78d1e42bd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:03.967952 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7d632f63-543b-4e9d-be4d-4ed78d1e42bd tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.159350 Jun 22 11:58:03.968517 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 479/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:03 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:04.985262 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8a9c25a7-339a-4c95-aa04-f40ed8751db0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:04.985927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8a9c25a7-339a-4c95-aa04-f40ed8751db0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:04.992900 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8a9c25a7-339a-4c95-aa04-f40ed8751db0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:04.993471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8a9c25a7-339a-4c95-aa04-f40ed8751db0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:04.994311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8a9c25a7-339a-4c95-aa04-f40ed8751db0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:04.995075 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8a9c25a7-339a-4c95-aa04-f40ed8751db0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:05.124558 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8a9c25a7-339a-4c95-aa04-f40ed8751db0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:05.131951 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8a9c25a7-339a-4c95-aa04-f40ed8751db0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.150972 Jun 22 11:58:05.132504 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 530/1009] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:04 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:06.149174 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4e8de686-a45a-433d-8243-0f5287f7f440 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:06.149781 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4e8de686-a45a-433d-8243-0f5287f7f440 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:06.157056 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e8de686-a45a-433d-8243-0f5287f7f440 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:06.157505 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e8de686-a45a-433d-8243-0f5287f7f440 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:06.158266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e8de686-a45a-433d-8243-0f5287f7f440 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:06.158706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4e8de686-a45a-433d-8243-0f5287f7f440 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:06.297410 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4e8de686-a45a-433d-8243-0f5287f7f440 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:06.304858 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4e8de686-a45a-433d-8243-0f5287f7f440 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.159532 Jun 22 11:58:06.305428 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 480/1010] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:06 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:07.322262 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8f9bb718-3828-470f-86bc-c5251b161e57 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:07.322787 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8f9bb718-3828-470f-86bc-c5251b161e57 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:07.329816 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f9bb718-3828-470f-86bc-c5251b161e57 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:07.330260 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f9bb718-3828-470f-86bc-c5251b161e57 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:07.331023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f9bb718-3828-470f-86bc-c5251b161e57 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:07.331505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8f9bb718-3828-470f-86bc-c5251b161e57 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:07.461155 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8f9bb718-3828-470f-86bc-c5251b161e57 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:07.468607 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8f9bb718-3828-470f-86bc-c5251b161e57 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.150474 Jun 22 11:58:07.469166 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 531/1011] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:07 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:08.485424 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-36fcfcd6-6ae6-4303-b22b-986c388cfdf1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:08.486031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-36fcfcd6-6ae6-4303-b22b-986c388cfdf1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:08.492534 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36fcfcd6-6ae6-4303-b22b-986c388cfdf1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:08.492977 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36fcfcd6-6ae6-4303-b22b-986c388cfdf1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:08.493736 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36fcfcd6-6ae6-4303-b22b-986c388cfdf1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:08.494178 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36fcfcd6-6ae6-4303-b22b-986c388cfdf1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:08.623235 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-36fcfcd6-6ae6-4303-b22b-986c388cfdf1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:08.630625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-36fcfcd6-6ae6-4303-b22b-986c388cfdf1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.149004 Jun 22 11:58:08.631182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 481/1012] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:08 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:09.647079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fe91c40b-cd01-4e90-a65f-3f589b80762d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:09.647753 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fe91c40b-cd01-4e90-a65f-3f589b80762d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:09.650025 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:09.655361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fe91c40b-cd01-4e90-a65f-3f589b80762d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:09.655817 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fe91c40b-cd01-4e90-a65f-3f589b80762d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:09.656628 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fe91c40b-cd01-4e90-a65f-3f589b80762d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:09.657061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fe91c40b-cd01-4e90-a65f-3f589b80762d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:09.790808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-fe91c40b-cd01-4e90-a65f-3f589b80762d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:09.798914 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fe91c40b-cd01-4e90-a65f-3f589b80762d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.155683 Jun 22 11:58:09.799510 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 532/1013] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:09 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:10.815572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4ffa7a40-2bc1-475e-a393-74b97b9f5efe tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:10.816146 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4ffa7a40-2bc1-475e-a393-74b97b9f5efe tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:10.818127 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:10.818770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=6 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:10.825697 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4ffa7a40-2bc1-475e-a393-74b97b9f5efe tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:10.826137 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4ffa7a40-2bc1-475e-a393-74b97b9f5efe tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:10.826892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4ffa7a40-2bc1-475e-a393-74b97b9f5efe tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:10.827320 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4ffa7a40-2bc1-475e-a393-74b97b9f5efe tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:10.959290 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4ffa7a40-2bc1-475e-a393-74b97b9f5efe tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:10.966805 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4ffa7a40-2bc1-475e-a393-74b97b9f5efe tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.155304 Jun 22 11:58:10.967383 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 482/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:10 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:11.984077 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0b79f0f8-a245-4777-9643-e4ed686c7668 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:11.984685 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0b79f0f8-a245-4777-9643-e4ed686c7668 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:11.991153 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0b79f0f8-a245-4777-9643-e4ed686c7668 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:11.991633 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0b79f0f8-a245-4777-9643-e4ed686c7668 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:11.992384 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0b79f0f8-a245-4777-9643-e4ed686c7668 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:11.992819 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0b79f0f8-a245-4777-9643-e4ed686c7668 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:12.131002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-0b79f0f8-a245-4777-9643-e4ed686c7668 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:12.139062 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0b79f0f8-a245-4777-9643-e4ed686c7668 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.158882 Jun 22 11:58:12.139641 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 533/1015] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:11 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:12.618835 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-1c16de65-3d05-43d0-9481-c7ceefbd598a req-6197cc25-413d-4432-a00f-2543353a2bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b514f999-4c83-4dbd-a556-1037c269dcf9", "name": "network-vif-plugged", "status": "completed", "tag": "015aa5d0-cc6d-4302-9e81-85c44da33007"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:12.627958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-1c16de65-3d05-43d0-9481-c7ceefbd598a req-6197cc25-413d-4432-a00f-2543353a2bc6 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:12.628395 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-1c16de65-3d05-43d0-9481-c7ceefbd598a req-6197cc25-413d-4432-a00f-2543353a2bc6 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:12.639912 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-1c16de65-3d05-43d0-9481-c7ceefbd598a req-6197cc25-413d-4432-a00f-2543353a2bc6 service nova] Creating event network-vif-plugged:015aa5d0-cc6d-4302-9e81-85c44da33007 for instance b514f999-4c83-4dbd-a556-1037c269dcf9 on hv-cinder-83697 Jun 22 11:58:12.645384 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-1c16de65-3d05-43d0-9481-c7ceefbd598a req-6197cc25-413d-4432-a00f-2543353a2bc6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030236 Jun 22 11:58:12.645974 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 483/1016] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:58:13.156747 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-862bcb00-1f74-48de-9210-2c022e0d4a19 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:13.157301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-862bcb00-1f74-48de-9210-2c022e0d4a19 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:13.163731 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-862bcb00-1f74-48de-9210-2c022e0d4a19 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:13.164176 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-862bcb00-1f74-48de-9210-2c022e0d4a19 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:13.164927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-862bcb00-1f74-48de-9210-2c022e0d4a19 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:13.165355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-862bcb00-1f74-48de-9210-2c022e0d4a19 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:13.297614 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-862bcb00-1f74-48de-9210-2c022e0d4a19 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:13.305260 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-862bcb00-1f74-48de-9210-2c022e0d4a19 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.152964 Jun 22 11:58:13.305815 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 534/1017] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:13 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:14.323186 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c9872bf8-dc42-43b0-a6e2-96ff7436ca62 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:14.323817 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c9872bf8-dc42-43b0-a6e2-96ff7436ca62 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:14.330151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9872bf8-dc42-43b0-a6e2-96ff7436ca62 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:14.330594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9872bf8-dc42-43b0-a6e2-96ff7436ca62 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:14.331380 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9872bf8-dc42-43b0-a6e2-96ff7436ca62 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:14.331829 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9872bf8-dc42-43b0-a6e2-96ff7436ca62 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:14.475886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c9872bf8-dc42-43b0-a6e2-96ff7436ca62 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:14.484008 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c9872bf8-dc42-43b0-a6e2-96ff7436ca62 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1265 microversion: 2.1 time: 0.165641 Jun 22 11:58:14.484573 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 484/1018] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:14 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:15.501612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d73d55f7-c351-462a-b416-442c589565a0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:15.502293 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d73d55f7-c351-462a-b416-442c589565a0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:15.509044 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d73d55f7-c351-462a-b416-442c589565a0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:15.509487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d73d55f7-c351-462a-b416-442c589565a0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:15.510250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d73d55f7-c351-462a-b416-442c589565a0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:15.510680 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d73d55f7-c351-462a-b416-442c589565a0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:15.641500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d73d55f7-c351-462a-b416-442c589565a0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:15.650092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d73d55f7-c351-462a-b416-442c589565a0 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1453 microversion: 2.1 time: 0.152339 Jun 22 11:58:15.650642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 535/1019] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:15 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:15.666149 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3e40bc54-b24a-49b3-9c9d-366cc9acd927 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:15.666755 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3e40bc54-b24a-49b3-9c9d-366cc9acd927 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:15.673873 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3e40bc54-b24a-49b3-9c9d-366cc9acd927 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:15.674317 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3e40bc54-b24a-49b3-9c9d-366cc9acd927 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:15.675074 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3e40bc54-b24a-49b3-9c9d-366cc9acd927 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:15.675542 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3e40bc54-b24a-49b3-9c9d-366cc9acd927 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:15.808632 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3e40bc54-b24a-49b3-9c9d-366cc9acd927 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:15.816785 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3e40bc54-b24a-49b3-9c9d-366cc9acd927 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1453 microversion: 2.1 time: 0.154480 Jun 22 11:58:15.817345 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 485/1020] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:15 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:17.512481 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-f99118cb-71b1-43f8-b377-cc1292128d80 req-e164bd20-b9a8-412a-8473-495bb0e23ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b514f999-4c83-4dbd-a556-1037c269dcf9", "tag": "015aa5d0-cc6d-4302-9e81-85c44da33007"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:17.520838 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-f99118cb-71b1-43f8-b377-cc1292128d80 req-e164bd20-b9a8-412a-8473-495bb0e23ef0 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:17.521278 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-f99118cb-71b1-43f8-b377-cc1292128d80 req-e164bd20-b9a8-412a-8473-495bb0e23ef0 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:17.533003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-f99118cb-71b1-43f8-b377-cc1292128d80 req-e164bd20-b9a8-412a-8473-495bb0e23ef0 service nova] Creating event network-changed:015aa5d0-cc6d-4302-9e81-85c44da33007 for instance b514f999-4c83-4dbd-a556-1037c269dcf9 on hv-cinder-83697 Jun 22 11:58:17.538135 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-f99118cb-71b1-43f8-b377-cc1292128d80 req-e164bd20-b9a8-412a-8473-495bb0e23ef0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157877 Jun 22 11:58:17.538730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 536/1021] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:58:22.618128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f316b165-6da9-4d2c-81f9-456c4194f023 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:22.619072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f316b165-6da9-4d2c-81f9-456c4194f023 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:22.625782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f316b165-6da9-4d2c-81f9-456c4194f023 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:22.626237 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f316b165-6da9-4d2c-81f9-456c4194f023 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:22.627003 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f316b165-6da9-4d2c-81f9-456c4194f023 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:22.627448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f316b165-6da9-4d2c-81f9-456c4194f023 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:22.657505 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f316b165-6da9-4d2c-81f9-456c4194f023 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043405 Jun 22 11:58:22.658071 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 486/1022] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 11:58:22 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:58:22.718453 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e9e277cc-47e2-45aa-b2a2-3db83094665b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:22.719036 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e9e277cc-47e2-45aa-b2a2-3db83094665b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:22.725789 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e9e277cc-47e2-45aa-b2a2-3db83094665b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:22.726241 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e9e277cc-47e2-45aa-b2a2-3db83094665b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:22.727013 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e9e277cc-47e2-45aa-b2a2-3db83094665b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:22.727478 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e9e277cc-47e2-45aa-b2a2-3db83094665b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:22.752324 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e9e277cc-47e2-45aa-b2a2-3db83094665b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 11:58:22.830802 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e9e277cc-47e2-45aa-b2a2-3db83094665b tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 204 len: 0 microversion: 2.20 time: 0.115991 Jun 22 11:58:22.831586 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 537/1023] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Jun 22 11:58:22 2022] DELETE /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 11:58:22.841410 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:22.842005 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:22.847983 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:22.848431 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:22.849195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:22.849651 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:22.979887 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:22.987713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:22.989226 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:22.990606 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2d4609cc-b3f8-44de-b238-58e53df432d4 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.154565 Jun 22 11:58:22.990958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 487/1024] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:58:22 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:58:24.009851 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:24.010674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:24.018065 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:24.018515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:24.019274 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:24.019727 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:24.156597 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:24.164473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:24.165960 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:24.167132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9f39ddfd-723a-47df-be06-42357f3bb2fd tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1722 microversion: 2.20 time: 0.161617 Jun 22 11:58:24.167707 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 538/1025] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:58:24 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:58:25.185420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:25.185997 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:25.188476 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:25.193662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:25.194103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:25.194850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:25.195274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:25.199994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:25.261361 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:25.270429 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:25.271942 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '034858240ac34e549aa5e0754726f9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64ad44d3c247caa7d106861916f245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:25.273088 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-89ea392f-0777-41a1-bbf0-77987d9a94ff tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 200 len: 1656 microversion: 2.20 time: 0.091667 Jun 22 11:58:25.273646 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 488/1026] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:58:25 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 11:58:25.463092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-e46c21e5-0be6-4859-af48-7a4317b6acee req-f3c017a1-3619-4df8-a43a-b4852e40bd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f26d8d-a0e4-4c9a-bf16-88ec416eba46", "name": "network-vif-deleted", "tag": "8c843eaa-9d2f-4212-b0db-0d0350968b30"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:25.467463 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:25.479041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-e46c21e5-0be6-4859-af48-7a4317b6acee req-f3c017a1-3619-4df8-a43a-b4852e40bd5c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:25.479535 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-e46c21e5-0be6-4859-af48-7a4317b6acee req-f3c017a1-3619-4df8-a43a-b4852e40bd5c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:25.484003 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:25.493816 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-e46c21e5-0be6-4859-af48-7a4317b6acee req-f3c017a1-3619-4df8-a43a-b4852e40bd5c service nova] Creating event network-vif-deleted:8c843eaa-9d2f-4212-b0db-0d0350968b30 for instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 on hv-cinder-83697 Jun 22 11:58:25.499136 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-e46c21e5-0be6-4859-af48-7a4317b6acee req-f3c017a1-3619-4df8-a43a-b4852e40bd5c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113408 Jun 22 11:58:25.500038 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 539/1027] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:58:26.292005 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:26.292591 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:26.299818 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:26.300377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:26.301139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:26.301575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:26.317780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] HTTP exception thrown: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Request method failure captured: Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 HTTP/1.1 Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswEuz90__KG4NaMuLrSw7iGMB7Jes-9BlrXMpKu3K9LMa_xFLGftoAg4HPrTIZha4KJs7qFsK9Vq06U1zgjTwh9sfHfZ6kfBTcJqwcC-ZZiVf87GbmAsoQPXDLDorRoZYHWT45FhdUldWLDJvSpkPBV0CBVmuil3jqt1SviIlhAWuj8 Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:58:26.319465 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f64ad44d3c247caa7d106861916f245", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 034858240ac34e549aa5e0754726f9c6 Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:26.321242 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '44f26d8d-a0e4-4c9a-bf16-88ec416eba46'} Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:58:26.322203 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:26.323850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:26.325286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Returning 404 to user: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:58:26.325286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4f94d664-a6ef-4650-9917-6973c6ebacc7 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 404 len: 111 microversion: 2.20 time: 0.032753 Jun 22 11:58:26.325286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 489/1028] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:58:26 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 11:58:26.334674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3b8aef03-ee46-45a8-8e6b-06e34313fce5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '.version_select at 0x7f3ea836eb80>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:26.352725 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3b8aef03-ee46-45a8-8e6b-06e34313fce5 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1189441356" status: 204 len: 0 microversion: 2.20 time: 0.022292 Jun 22 11:58:26.353406 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 540/1029] 10.222.0.36 () {60 vars in 1261 bytes} [Wed Jun 22 11:58:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1189441356 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 11:58:28.089239 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:28.089844 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:28.096786 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:28.097235 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:28.098012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:28.098443 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:28.112698 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] HTTP exception thrown: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Request method failure captured: Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 HTTP/1.1 Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswEuz90__KG4NaMuLrSw7iGMB7Jes-9BlrXMpKu3K9LMa_xFLGftoAg4HPrTIZha4KJs7qFsK9Vq06U1zgjTwh9sfHfZ6kfBTcJqwcC-ZZiVf87GbmAsoQPXDLDorRoZYHWT45FhdUldWLDJvSpkPBV0CBVmuil3jqt1SviIlhAWuj8 Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:58:28.114286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f64ad44d3c247caa7d106861916f245", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 034858240ac34e549aa5e0754726f9c6 Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.116013 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '44f26d8d-a0e4-4c9a-bf16-88ec416eba46'} Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:58:28.116961 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.118238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.119526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Returning 404 to user: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:58:28.119526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-516288b6-b71d-465d-82de-f39924f8cc95 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 404 len: 111 microversion: 2.20 time: 0.030404 Jun 22 11:58:28.119526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 490/1030] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Jun 22 11:58:28 2022] DELETE /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 11:58:28.124981 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:28.125703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: 44f26d8d-a0e4-4c9a-bf16-88ec416eba46] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:28.132342 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:28.132802 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:28.133554 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:28.133988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:28.149897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] HTTP exception thrown: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Request method failure captured: Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 HTTP/1.1 Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswEuz90__KG4NaMuLrSw7iGMB7Jes-9BlrXMpKu3K9LMa_xFLGftoAg4HPrTIZha4KJs7qFsK9Vq06U1zgjTwh9sfHfZ6kfBTcJqwcC-ZZiVf87GbmAsoQPXDLDorRoZYHWT45FhdUldWLDJvSpkPBV0CBVmuil3jqt1SviIlhAWuj8 Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:58:28.151576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f64ad44d3c247caa7d106861916f245", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 034858240ac34e549aa5e0754726f9c6 Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.153818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '44f26d8d-a0e4-4c9a-bf16-88ec416eba46'} Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:58:28.154741 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. Jun 22 11:58:28.156300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:28.157656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Returning 404 to user: Instance 44f26d8d-a0e4-4c9a-bf16-88ec416eba46 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:58:28.157656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f117c82d-75d9-4303-8161-72e919ed91de tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46" status: 404 len: 111 microversion: 2.20 time: 0.031873 Jun 22 11:58:28.157656 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 541/1031] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:58:28 2022] GET /compute/v2.1/servers/44f26d8d-a0e4-4c9a-bf16-88ec416eba46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 11:58:29.290072 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:29.290568 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:29.297542 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:29.297984 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:29.298740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:29.299170 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:29.313158 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] HTTP exception thrown: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Request method failure captured: Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 HTTP/1.1 Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswEuz90__KG4NaMuLrSw7iGMB7Jes-9BlrXMpKu3K9LMa_xFLGftoAg4HPrTIZha4KJs7qFsK9Vq06U1zgjTwh9sfHfZ6kfBTcJqwcC-ZZiVf87GbmAsoQPXDLDorRoZYHWT45FhdUldWLDJvSpkPBV0CBVmuil3jqt1SviIlhAWuj8 Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 11:58:29.314706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f64ad44d3c247caa7d106861916f245", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 034858240ac34e549aa5e0754726f9c6 Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.316423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'f5b85599-217c-4d95-a8ef-136d2368cf70'} Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:58:29.317302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.318962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.320647 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Returning 404 to user: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:58:29.320647 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-11c17694-a20d-4483-9efb-fcb370638538 tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 404 len: 111 microversion: 2.20 time: 0.029926 Jun 22 11:58:29.320647 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 491/1032] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Jun 22 11:58:29 2022] DELETE /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 11:58:29.324595 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:29.325198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] [instance: f5b85599-217c-4d95-a8ef-136d2368cf70] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:29.331340 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:29.331806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:29.332554 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:29.332984 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:29.346112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] HTTP exception thrown: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Request method failure captured: Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 HTTP/1.1 Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswEuz90__KG4NaMuLrSw7iGMB7Jes-9BlrXMpKu3K9LMa_xFLGftoAg4HPrTIZha4KJs7qFsK9Vq06U1zgjTwh9sfHfZ6kfBTcJqwcC-ZZiVf87GbmAsoQPXDLDorRoZYHWT45FhdUldWLDJvSpkPBV0CBVmuil3jqt1SviIlhAWuj8 Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 11:58:29.347675 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f64ad44d3c247caa7d106861916f245", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f64ad44d3c247caa7d106861916f245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 6f64ad44d3c247caa7d106861916f245 Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333287263 Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 034858240ac34e549aa5e0754726f9c6 Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333287263-project Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.349410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'f5b85599-217c-4d95-a8ef-136d2368cf70'} Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 11:58:29.350275 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. Jun 22 11:58:29.351825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 11:58:29.353169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] Returning 404 to user: Instance f5b85599-217c-4d95-a8ef-136d2368cf70 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 11:58:29.353169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-fdd39a87-dafd-4d0f-9d40-b9e6ec72169a tempest-AttachVolumeShelveTestJSON-1333287263 tempest-AttachVolumeShelveTestJSON-1333287263-project] 10.222.0.36 "GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70" status: 404 len: 111 microversion: 2.20 time: 0.028219 Jun 22 11:58:29.353169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 542/1033] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 11:58:29 2022] GET /compute/v2.1/servers/f5b85599-217c-4d95-a8ef-136d2368cf70 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 11:58:37.866934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-76f9895d-342f-44d2-a679-dbe0117bc64c tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: .version_select at 0x7f3ea82ecd30>, body: {"keypair": {"name": "tempest-keypair-1311917456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXfTR2ffDc2AHcxpwFCwhLyAmXl8FbD14LEmqMnOa6Koc2Tkj+TBokkQNpsc8PrfIzKZqDT3xzuV2ngDhZtTLgP3q7kPedaYzdrEoSxH4VBHyIy59vgdKJCI0H/JGu7hA=="}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:37.881969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-76f9895d-342f-44d2-a679-dbe0117bc64c tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for project 897ec8bf954c41648da9cac00bc44749. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:58:37.886093 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-76f9895d-342f-44d2-a679-dbe0117bc64c tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for user f2d34a97831f4a7c885ebe64aecb3669 and project 897ec8bf954c41648da9cac00bc44749. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:58:37.900499 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR oslo.messaging._drivers.impl_rabbit [None req-76f9895d-342f-44d2-a679-dbe0117bc64c tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [970ce608-669d-48f6-a8b8-91cef762f1ef] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 11:58:38.908333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [None req-76f9895d-342f-44d2-a679-dbe0117bc64c tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [970ce608-669d-48f6-a8b8-91cef762f1ef] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 53178. Jun 22 11:58:38.923740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-76f9895d-342f-44d2-a679-dbe0117bc64c tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.197360 Jun 22 11:58:38.924330 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 492/1034] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 11:58:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:58:40.316843 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1147240651", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c591d2a-1888-4ad8-90c9-cd1f4c969134"}], "security_groups": [{"name": "tempest-securitygroup--152044671"}], "key_name": "tempest-keypair-1311917456", "user_data": "}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:40.326043 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:40.327264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=5 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:40.452848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] validate_networks() for [('0c591d2a-1888-4ad8-90c9-cd1f4c969134', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 11:58:40.925940 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 11:58:40.926355 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 11:58:40.927031 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 11:58:40.927465 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 11:58:40.927872 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 11:58:40.937177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:40.937615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:40.938860 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:40.939510 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:40.956841 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for project 897ec8bf954c41648da9cac00bc44749. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 11:58:40.961164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for user f2d34a97831f4a7c885ebe64aecb3669 and project 897ec8bf954c41648da9cac00bc44749. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 11:58:40.973290 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 11:58:40.975606 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 11:58:41.025431 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1a28e533-d97c-48eb-b4a8-c37e374b1d25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.713403 Jun 22 11:58:41.026237 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 543/1035] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 11:58:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 11:58:41.033466 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=11 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:41.039287 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-428a834f-ff3f-4e37-907e-89cf2725be21 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:41.039947 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-428a834f-ff3f-4e37-907e-89cf2725be21 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:41.095053 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-428a834f-ff3f-4e37-907e-89cf2725be21 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:41.103808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-428a834f-ff3f-4e37-907e-89cf2725be21 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1242 microversion: 2.1 time: 0.070919 Jun 22 11:58:41.104388 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 493/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:41 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:58:42.121519 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2e128b6f-4d7a-4062-917a-cc958dcf2b70 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:42.122970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2e128b6f-4d7a-4062-917a-cc958dcf2b70 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:42.130311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2e128b6f-4d7a-4062-917a-cc958dcf2b70 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:42.131067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2e128b6f-4d7a-4062-917a-cc958dcf2b70 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:42.132092 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2e128b6f-4d7a-4062-917a-cc958dcf2b70 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:42.132816 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2e128b6f-4d7a-4062-917a-cc958dcf2b70 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:42.205557 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2e128b6f-4d7a-4062-917a-cc958dcf2b70 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:42.213423 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2e128b6f-4d7a-4062-917a-cc958dcf2b70 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1312 microversion: 2.1 time: 0.096639 Jun 22 11:58:42.214573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 544/1037] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:42 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:43.231231 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d591c12f-354f-4d5e-b50c-7b8f77f7d087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:43.231897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d591c12f-354f-4d5e-b50c-7b8f77f7d087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:43.238483 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d591c12f-354f-4d5e-b50c-7b8f77f7d087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:43.238940 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d591c12f-354f-4d5e-b50c-7b8f77f7d087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:43.239723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d591c12f-354f-4d5e-b50c-7b8f77f7d087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:43.240155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d591c12f-354f-4d5e-b50c-7b8f77f7d087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:43.386327 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d591c12f-354f-4d5e-b50c-7b8f77f7d087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:43.397071 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d591c12f-354f-4d5e-b50c-7b8f77f7d087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.169520 Jun 22 11:58:43.398353 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 494/1038] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:43 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:43.406445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-dcf45dbc-d148-407d-b78e-79542e2ff4cf req-2bd28cfa-6435-4516-bc49-07c2d53c93b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58808877-ad76-46f6-9d87-ad3620eaa37b", "tag": "d630e829-11cc-4aeb-bc02-c8af1cfc5f81"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:43.420164 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-dcf45dbc-d148-407d-b78e-79542e2ff4cf req-2bd28cfa-6435-4516-bc49-07c2d53c93b8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:43.420856 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-dcf45dbc-d148-407d-b78e-79542e2ff4cf req-2bd28cfa-6435-4516-bc49-07c2d53c93b8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:43.434096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-dcf45dbc-d148-407d-b78e-79542e2ff4cf req-2bd28cfa-6435-4516-bc49-07c2d53c93b8 service nova] Creating event network-changed:d630e829-11cc-4aeb-bc02-c8af1cfc5f81 for instance 58808877-ad76-46f6-9d87-ad3620eaa37b on hv-cinder-83697 Jun 22 11:58:43.439719 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-dcf45dbc-d148-407d-b78e-79542e2ff4cf req-2bd28cfa-6435-4516-bc49-07c2d53c93b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037021 Jun 22 11:58:43.440303 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 545/1039] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:58:44.414338 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b58e926e-8ab8-4fdf-9e60-caf55a7c4570 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:44.414926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b58e926e-8ab8-4fdf-9e60-caf55a7c4570 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:44.421132 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b58e926e-8ab8-4fdf-9e60-caf55a7c4570 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:44.421620 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b58e926e-8ab8-4fdf-9e60-caf55a7c4570 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:44.422390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b58e926e-8ab8-4fdf-9e60-caf55a7c4570 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:44.422816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b58e926e-8ab8-4fdf-9e60-caf55a7c4570 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:44.551083 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b58e926e-8ab8-4fdf-9e60-caf55a7c4570 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:44.558443 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b58e926e-8ab8-4fdf-9e60-caf55a7c4570 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.148218 Jun 22 11:58:44.559034 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 495/1040] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:44 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:45.577346 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6db601c8-d83e-4cf1-9701-6c300f520d0e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:45.578031 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6db601c8-d83e-4cf1-9701-6c300f520d0e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:45.584255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6db601c8-d83e-4cf1-9701-6c300f520d0e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:45.584698 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6db601c8-d83e-4cf1-9701-6c300f520d0e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:45.585443 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6db601c8-d83e-4cf1-9701-6c300f520d0e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:45.585873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6db601c8-d83e-4cf1-9701-6c300f520d0e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:45.722022 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6db601c8-d83e-4cf1-9701-6c300f520d0e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:45.729422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6db601c8-d83e-4cf1-9701-6c300f520d0e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.157291 Jun 22 11:58:45.729989 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 546/1041] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:45 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:46.749919 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c64d4659-09d6-4554-9a61-b6d94b57a7bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:46.751031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c64d4659-09d6-4554-9a61-b6d94b57a7bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:46.760189 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c64d4659-09d6-4554-9a61-b6d94b57a7bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:46.760634 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c64d4659-09d6-4554-9a61-b6d94b57a7bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:46.761397 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c64d4659-09d6-4554-9a61-b6d94b57a7bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:46.761827 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c64d4659-09d6-4554-9a61-b6d94b57a7bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:46.889591 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c64d4659-09d6-4554-9a61-b6d94b57a7bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:46.897139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c64d4659-09d6-4554-9a61-b6d94b57a7bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.154620 Jun 22 11:58:46.897687 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 496/1042] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:46 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:47.913988 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d6567d54-92e6-4757-9cb9-b64112e43da7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:47.914567 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d6567d54-92e6-4757-9cb9-b64112e43da7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:47.921554 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d6567d54-92e6-4757-9cb9-b64112e43da7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:47.921996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d6567d54-92e6-4757-9cb9-b64112e43da7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:47.922747 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d6567d54-92e6-4757-9cb9-b64112e43da7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:47.923172 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d6567d54-92e6-4757-9cb9-b64112e43da7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:48.054041 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d6567d54-92e6-4757-9cb9-b64112e43da7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:48.061978 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d6567d54-92e6-4757-9cb9-b64112e43da7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.151804 Jun 22 11:58:48.062531 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 547/1043] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:47 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:49.080248 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6d5565a0-4467-4771-bb9a-0c4aae61bb5a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:49.080922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6d5565a0-4467-4771-bb9a-0c4aae61bb5a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:49.087502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d5565a0-4467-4771-bb9a-0c4aae61bb5a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:49.087954 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d5565a0-4467-4771-bb9a-0c4aae61bb5a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:49.088721 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d5565a0-4467-4771-bb9a-0c4aae61bb5a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:49.089152 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6d5565a0-4467-4771-bb9a-0c4aae61bb5a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:49.224828 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6d5565a0-4467-4771-bb9a-0c4aae61bb5a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:49.232472 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6d5565a0-4467-4771-bb9a-0c4aae61bb5a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.156621 Jun 22 11:58:49.233830 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 497/1044] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:49 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 11:58:50.249200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c9b08a37-888e-47be-a486-dc0e4ab715cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:50.249761 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c9b08a37-888e-47be-a486-dc0e4ab715cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:50.256132 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c9b08a37-888e-47be-a486-dc0e4ab715cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:50.256572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c9b08a37-888e-47be-a486-dc0e4ab715cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:50.257317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c9b08a37-888e-47be-a486-dc0e4ab715cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:50.257747 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c9b08a37-888e-47be-a486-dc0e4ab715cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:50.388500 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c9b08a37-888e-47be-a486-dc0e4ab715cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:50.396764 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c9b08a37-888e-47be-a486-dc0e4ab715cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.152059 Jun 22 11:58:50.397582 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 548/1045] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:50 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:50.785972 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-eb3411bb-4276-444b-8f5a-e242775dc996 req-b07bfcee-59e2-4fee-9a65-f93eee30764f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58808877-ad76-46f6-9d87-ad3620eaa37b", "name": "network-vif-plugged", "status": "completed", "tag": "d630e829-11cc-4aeb-bc02-c8af1cfc5f81"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:50.796027 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-eb3411bb-4276-444b-8f5a-e242775dc996 req-b07bfcee-59e2-4fee-9a65-f93eee30764f service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:50.796474 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-eb3411bb-4276-444b-8f5a-e242775dc996 req-b07bfcee-59e2-4fee-9a65-f93eee30764f service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:50.808052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-eb3411bb-4276-444b-8f5a-e242775dc996 req-b07bfcee-59e2-4fee-9a65-f93eee30764f service nova] Creating event network-vif-plugged:d630e829-11cc-4aeb-bc02-c8af1cfc5f81 for instance 58808877-ad76-46f6-9d87-ad3620eaa37b on hv-cinder-83697 Jun 22 11:58:50.813858 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-eb3411bb-4276-444b-8f5a-e242775dc996 req-b07bfcee-59e2-4fee-9a65-f93eee30764f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031391 Jun 22 11:58:50.814603 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 498/1046] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:58:51.414356 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-97da6c84-083f-477a-931a-8e5901e7ba69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:51.414976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-97da6c84-083f-477a-931a-8e5901e7ba69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:51.417023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:51.417824 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=6 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:51.423877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-97da6c84-083f-477a-931a-8e5901e7ba69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:51.424322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-97da6c84-083f-477a-931a-8e5901e7ba69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:51.425084 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-97da6c84-083f-477a-931a-8e5901e7ba69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:51.425512 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-97da6c84-083f-477a-931a-8e5901e7ba69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:51.560282 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-97da6c84-083f-477a-931a-8e5901e7ba69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:51.567802 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-97da6c84-083f-477a-931a-8e5901e7ba69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.157538 Jun 22 11:58:51.568556 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 549/1047] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:51 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:52.586251 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2b73e6c1-3da7-4351-90d7-c7914f385ee2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:52.586852 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2b73e6c1-3da7-4351-90d7-c7914f385ee2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:52.588768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=6 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 11:58:52.594814 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b73e6c1-3da7-4351-90d7-c7914f385ee2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:52.595255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b73e6c1-3da7-4351-90d7-c7914f385ee2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:52.596042 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b73e6c1-3da7-4351-90d7-c7914f385ee2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:52.596468 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b73e6c1-3da7-4351-90d7-c7914f385ee2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:52.724792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2b73e6c1-3da7-4351-90d7-c7914f385ee2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:52.733041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2b73e6c1-3da7-4351-90d7-c7914f385ee2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1367 microversion: 2.1 time: 0.150538 Jun 22 11:58:52.733607 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 499/1048] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:52 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:53.749849 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6bd4b732-946f-4199-a17e-f555a672be46 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:53.750538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6bd4b732-946f-4199-a17e-f555a672be46 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:53.756884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bd4b732-946f-4199-a17e-f555a672be46 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:53.757327 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bd4b732-946f-4199-a17e-f555a672be46 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:53.758095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bd4b732-946f-4199-a17e-f555a672be46 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:53.758524 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6bd4b732-946f-4199-a17e-f555a672be46 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:54.148878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6bd4b732-946f-4199-a17e-f555a672be46 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 11:58:54.156402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6bd4b732-946f-4199-a17e-f555a672be46 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1556 microversion: 2.1 time: 0.410643 Jun 22 11:58:54.156956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 550/1049] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 11:58:53 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1556 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 11:58:54.172560 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c0b79d60-964c-41c3-8f60-9eba19fadc1d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 11:58:54.173053 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c0b79d60-964c-41c3-8f60-9eba19fadc1d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 11:58:54.179525 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c0b79d60-964c-41c3-8f60-9eba19fadc1d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:54.179968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c0b79d60-964c-41c3-8f60-9eba19fadc1d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:54.180719 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c0b79d60-964c-41c3-8f60-9eba19fadc1d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:54.181143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c0b79d60-964c-41c3-8f60-9eba19fadc1d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:54.256787 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c0b79d60-964c-41c3-8f60-9eba19fadc1d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087959 Jun 22 11:58:54.257389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 500/1050] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 11:58:54 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 11:58:55.409311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-48fb1dce-77bc-49da-824e-939653a68f55 req-ace3606b-4b76-48cc-8287-c3e830081937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58808877-ad76-46f6-9d87-ad3620eaa37b", "tag": "d630e829-11cc-4aeb-bc02-c8af1cfc5f81"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 11:58:55.417792 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-48fb1dce-77bc-49da-824e-939653a68f55 req-ace3606b-4b76-48cc-8287-c3e830081937 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 11:58:55.418224 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-48fb1dce-77bc-49da-824e-939653a68f55 req-ace3606b-4b76-48cc-8287-c3e830081937 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 11:58:55.428949 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-48fb1dce-77bc-49da-824e-939653a68f55 req-ace3606b-4b76-48cc-8287-c3e830081937 service nova] Creating event network-changed:d630e829-11cc-4aeb-bc02-c8af1cfc5f81 for instance 58808877-ad76-46f6-9d87-ad3620eaa37b on hv-cinder-83697 Jun 22 11:58:55.434012 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-48fb1dce-77bc-49da-824e-939653a68f55 req-ace3606b-4b76-48cc-8287-c3e830081937 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028304 Jun 22 11:58:55.434648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 551/1051] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:22.262478 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c99940e-4b67-4b8f-89c1-1e4a416e5307] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 12:00:22.263035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:22.263675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=36 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:22.268085 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e0fae394-cdfb-405e-833d-fdab05cb74bd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:22.268596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e0fae394-cdfb-405e-833d-fdab05cb74bd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:22.276188 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0fae394-cdfb-405e-833d-fdab05cb74bd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:22.276624 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0fae394-cdfb-405e-833d-fdab05cb74bd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:22.277371 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0fae394-cdfb-405e-833d-fdab05cb74bd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:22.277823 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e0fae394-cdfb-405e-833d-fdab05cb74bd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:22.301555 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e0fae394-cdfb-405e-833d-fdab05cb74bd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/ips" status: 200 len: 148 microversion: 2.1 time: 0.040926 Jun 22 12:00:22.302115 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 501/1052] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 12:00:22 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:25.747850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:25.748718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=42 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:25.753418 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-05ae4528-74b7-4779-95af-197c9b01cb2f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a944c699-214a-4baf-b0e3-7d75398e1b61"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:25.754583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-05ae4528-74b7-4779-95af-197c9b01cb2f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:25.761750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-05ae4528-74b7-4779-95af-197c9b01cb2f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:25.762198 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-05ae4528-74b7-4779-95af-197c9b01cb2f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:25.762962 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-05ae4528-74b7-4779-95af-197c9b01cb2f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:25.763422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-05ae4528-74b7-4779-95af-197c9b01cb2f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:26.041011 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-05ae4528-74b7-4779-95af-197c9b01cb2f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295071 Jun 22 12:00:26.041678 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 552/1053] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 12:00:25 2022] POST /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:27.135243 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:00:27.135744 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 12:00:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:00:32.298092 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-429037277", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-979420716", "security_groups": [{"name": "tempest-secgroup-smoke-884704384"}], "block_device_mapping_v2": [{"uuid": "f1d3adfc-2944-4d89-a21d-97e0c3c27e19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b232377-d4d3-4e90-9c76-2affccfcccc5"}]}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:32.306607 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:32.307255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:32.321283 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c99940e-4b67-4b8f-89c1-1e4a416e5307] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 53386. Jun 22 12:00:32.417888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] validate_networks() for [('9b232377-d4d3-4e90-9c76-2affccfcccc5', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 12:00:32.773172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 12:00:32.773585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 12:00:32.774049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 12:00:32.774448 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 12:00:32.774851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 12:00:32.784069 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:32.784654 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:32.785317 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:32.785861 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:32.808168 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Getting quotas for project edbd324693e24bcdbf41c207d29d7e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:00:32.812089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Getting quotas for user 239de565f79f474bb21699fd9adc96c4 and project edbd324693e24bcdbf41c207d29d7e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:00:32.866881 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 12:00:32.869074 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1d3adfc-2944-4d89-a21d-97e0c3c27e19',volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 12:00:32.999602 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-10ac5836-72fa-4b19-bd9b-e1e7ae3f4f01 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705307 Jun 22 12:00:33.000423 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 502/1054] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 12:00:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 12:00:33.011239 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-53e0cc06-9ee4-439c-8ca2-b47bd35f1894 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:33.011961 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-53e0cc06-9ee4-439c-8ca2-b47bd35f1894 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:33.068769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-53e0cc06-9ee4-439c-8ca2-b47bd35f1894 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:33.075403 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-53e0cc06-9ee4-439c-8ca2-b47bd35f1894 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1093 microversion: 2.1 time: 0.068794 Jun 22 12:00:33.075956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 553/1055] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:33 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:34.092994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ed609b7f-4015-4e01-a664-355726692a23 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:34.093680 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ed609b7f-4015-4e01-a664-355726692a23 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:34.101793 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ed609b7f-4015-4e01-a664-355726692a23 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:34.102241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ed609b7f-4015-4e01-a664-355726692a23 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:34.103009 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ed609b7f-4015-4e01-a664-355726692a23 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:34.103645 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ed609b7f-4015-4e01-a664-355726692a23 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:34.166308 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ed609b7f-4015-4e01-a664-355726692a23 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:34.175018 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ed609b7f-4015-4e01-a664-355726692a23 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1209 microversion: 2.1 time: 0.086043 Jun 22 12:00:34.175612 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 503/1056] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:34 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:35.193002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4059eabd-5e1a-40d8-bc2d-0d0d3fd95beb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:35.194336 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4059eabd-5e1a-40d8-bc2d-0d0d3fd95beb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:35.203072 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4059eabd-5e1a-40d8-bc2d-0d0d3fd95beb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:35.203602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4059eabd-5e1a-40d8-bc2d-0d0d3fd95beb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:35.204523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4059eabd-5e1a-40d8-bc2d-0d0d3fd95beb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:35.205110 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4059eabd-5e1a-40d8-bc2d-0d0d3fd95beb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:35.343622 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-30deb0d4-8efa-472b-ab02-1b32eec9286c req-58516631-db1e-44db-a0ee-a74691699716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5", "tag": "9d063124-fca9-4ccc-a48c-caf8bf3ca42b"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:35.358909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-30deb0d4-8efa-472b-ab02-1b32eec9286c req-58516631-db1e-44db-a0ee-a74691699716 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:35.359285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-30deb0d4-8efa-472b-ab02-1b32eec9286c req-58516631-db1e-44db-a0ee-a74691699716 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:35.371970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-30deb0d4-8efa-472b-ab02-1b32eec9286c req-58516631-db1e-44db-a0ee-a74691699716 service nova] Creating event network-changed:9d063124-fca9-4ccc-a48c-caf8bf3ca42b for instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 on hv-cinder-83697 Jun 22 12:00:35.376863 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-30deb0d4-8efa-472b-ab02-1b32eec9286c req-58516631-db1e-44db-a0ee-a74691699716 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038145 Jun 22 12:00:35.378220 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 504/1057] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:35.454616 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4059eabd-5e1a-40d8-bc2d-0d0d3fd95beb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:35.462844 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4059eabd-5e1a-40d8-bc2d-0d0d3fd95beb tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1276 microversion: 2.1 time: 0.274957 Jun 22 12:00:35.463440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 554/1058] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:35 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:36.481543 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d595f5e9-d08a-4f13-ad53-3b7959dbd288 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:36.482283 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d595f5e9-d08a-4f13-ad53-3b7959dbd288 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:36.488909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d595f5e9-d08a-4f13-ad53-3b7959dbd288 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:36.489352 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d595f5e9-d08a-4f13-ad53-3b7959dbd288 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:36.490103 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d595f5e9-d08a-4f13-ad53-3b7959dbd288 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:36.490527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d595f5e9-d08a-4f13-ad53-3b7959dbd288 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:36.626519 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d595f5e9-d08a-4f13-ad53-3b7959dbd288 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:36.634591 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d595f5e9-d08a-4f13-ad53-3b7959dbd288 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1276 microversion: 2.1 time: 0.157697 Jun 22 12:00:36.635140 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 505/1059] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:36 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:37.651296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-91a98896-dead-47b1-b6d5-655362422c71 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:37.651927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-91a98896-dead-47b1-b6d5-655362422c71 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:37.658337 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91a98896-dead-47b1-b6d5-655362422c71 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:37.658778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91a98896-dead-47b1-b6d5-655362422c71 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:37.659559 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91a98896-dead-47b1-b6d5-655362422c71 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:37.659986 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-91a98896-dead-47b1-b6d5-655362422c71 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:37.788316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-91a98896-dead-47b1-b6d5-655362422c71 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:37.795847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-91a98896-dead-47b1-b6d5-655362422c71 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1276 microversion: 2.1 time: 0.148281 Jun 22 12:00:37.796427 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 555/1060] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:37 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:38.804990 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4c76ceb9-073b-49c2-992e-258b451bfe25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: .version_select at 0x7f3ea84bf0d0>, body: {"keypair": {"name": "tempest-keypair-900987100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfgbLKih2aGGrRVMCTc+M4UfRdUiWgs1gGwl5K7mFqW9DJEEwLgTKInxp2WkitrER6+GzIU7RrmXUjtVsYN1lai7hh8YBxHBPTD60PMeq5iQd3cem+6ycAhLKZYm98E0g=="}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:38.813447 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-526e6e20-6af2-4ba2-95c4-a07a14659a96 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:38.814185 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-526e6e20-6af2-4ba2-95c4-a07a14659a96 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:38.820389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-4c76ceb9-073b-49c2-992e-258b451bfe25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for project 897ec8bf954c41648da9cac00bc44749. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:00:38.821429 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-526e6e20-6af2-4ba2-95c4-a07a14659a96 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:38.821950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-526e6e20-6af2-4ba2-95c4-a07a14659a96 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:38.822766 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-526e6e20-6af2-4ba2-95c4-a07a14659a96 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:38.823200 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-526e6e20-6af2-4ba2-95c4-a07a14659a96 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:38.824382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-4c76ceb9-073b-49c2-992e-258b451bfe25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for user f2d34a97831f4a7c885ebe64aecb3669 and project 897ec8bf954c41648da9cac00bc44749. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:00:38.846388 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4c76ceb9-073b-49c2-992e-258b451bfe25 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045189 Jun 22 12:00:38.847002 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 506/1061] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 12:00:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:38.969753 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-526e6e20-6af2-4ba2-95c4-a07a14659a96 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:38.977588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-526e6e20-6af2-4ba2-95c4-a07a14659a96 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.167859 Jun 22 12:00:38.978256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 556/1062] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:38 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:39.997331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-12b04c1b-d124-4742-bfb1-cf6c2af20fd9 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:39.997943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-12b04c1b-d124-4742-bfb1-cf6c2af20fd9 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:40.004675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-12b04c1b-d124-4742-bfb1-cf6c2af20fd9 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:40.005182 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-12b04c1b-d124-4742-bfb1-cf6c2af20fd9 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:40.005943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-12b04c1b-d124-4742-bfb1-cf6c2af20fd9 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:40.006402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-12b04c1b-d124-4742-bfb1-cf6c2af20fd9 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:40.067559 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1840123990", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c591d2a-1888-4ad8-90c9-cd1f4c969134"}], "security_groups": [{"name": "tempest-securitygroup--641709929"}], "key_name": "tempest-keypair-900987100", "user_data": "}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:40.160348 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-12b04c1b-d124-4742-bfb1-cf6c2af20fd9 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:40.167897 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-12b04c1b-d124-4742-bfb1-cf6c2af20fd9 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.174885 Jun 22 12:00:40.168737 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 507/1063] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:39 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:40.184652 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] validate_networks() for [('0c591d2a-1888-4ad8-90c9-cd1f4c969134', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 12:00:40.544631 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 12:00:40.545050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 12:00:40.545540 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 12:00:40.545942 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 12:00:40.546346 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 12:00:40.555690 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:40.556134 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:40.556976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:40.557409 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:40.574217 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for project 897ec8bf954c41648da9cac00bc44749. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:00:40.578129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for user f2d34a97831f4a7c885ebe64aecb3669 and project 897ec8bf954c41648da9cac00bc44749. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:00:40.589170 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 12:00:40.591388 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 12:00:40.637159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-35045a51-5abd-4569-be2e-c3fa8e880be1 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573814 Jun 22 12:00:40.637715 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 557/1064] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 12:00:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 12:00:40.647842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-dd993782-ccd9-4522-b0f0-408be7015280 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:40.648458 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-dd993782-ccd9-4522-b0f0-408be7015280 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:40.707092 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-dd993782-ccd9-4522-b0f0-408be7015280 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:40.713901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-dd993782-ccd9-4522-b0f0-408be7015280 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1241 microversion: 2.1 time: 0.070178 Jun 22 12:00:40.714463 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 508/1065] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:40 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:41.185537 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-148f92bf-a19d-4a90-9203-e715f992605e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:41.186152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-148f92bf-a19d-4a90-9203-e715f992605e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:41.192997 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-148f92bf-a19d-4a90-9203-e715f992605e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:41.193457 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-148f92bf-a19d-4a90-9203-e715f992605e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:41.194223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-148f92bf-a19d-4a90-9203-e715f992605e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:41.194658 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-148f92bf-a19d-4a90-9203-e715f992605e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:41.329697 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-148f92bf-a19d-4a90-9203-e715f992605e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:41.337898 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-148f92bf-a19d-4a90-9203-e715f992605e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.156832 Jun 22 12:00:41.338459 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 558/1066] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:41 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:41.730172 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-06501daf-4319-4a74-8090-b4b51443ff3f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:41.730916 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-06501daf-4319-4a74-8090-b4b51443ff3f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:41.740913 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-06501daf-4319-4a74-8090-b4b51443ff3f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:41.741354 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-06501daf-4319-4a74-8090-b4b51443ff3f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:41.742107 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-06501daf-4319-4a74-8090-b4b51443ff3f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:41.742533 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-06501daf-4319-4a74-8090-b4b51443ff3f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:41.806802 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-06501daf-4319-4a74-8090-b4b51443ff3f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:41.815297 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-06501daf-4319-4a74-8090-b4b51443ff3f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1299 microversion: 2.1 time: 0.088511 Jun 22 12:00:41.815875 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 509/1067] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:41 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:42.356770 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1521384b-9a8a-4f26-a51b-37c473ffc259 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:42.357146 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1521384b-9a8a-4f26-a51b-37c473ffc259 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:42.367869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1521384b-9a8a-4f26-a51b-37c473ffc259 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:42.368365 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1521384b-9a8a-4f26-a51b-37c473ffc259 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:42.369154 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1521384b-9a8a-4f26-a51b-37c473ffc259 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:42.369763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1521384b-9a8a-4f26-a51b-37c473ffc259 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:42.524341 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1521384b-9a8a-4f26-a51b-37c473ffc259 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:42.532494 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1521384b-9a8a-4f26-a51b-37c473ffc259 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.181023 Jun 22 12:00:42.533169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 559/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:42 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:42.833029 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c9b62ad2-84d6-43d3-b715-1257b4eabf35 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:42.833605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c9b62ad2-84d6-43d3-b715-1257b4eabf35 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:42.836023 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:42.841727 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9b62ad2-84d6-43d3-b715-1257b4eabf35 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:42.842217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9b62ad2-84d6-43d3-b715-1257b4eabf35 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:42.843433 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9b62ad2-84d6-43d3-b715-1257b4eabf35 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:42.843868 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c9b62ad2-84d6-43d3-b715-1257b4eabf35 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:42.994035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c9b62ad2-84d6-43d3-b715-1257b4eabf35 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:43.003401 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c9b62ad2-84d6-43d3-b715-1257b4eabf35 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.174469 Jun 22 12:00:43.004264 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 510/1069] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:42 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:43.141899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-312b5c55-1562-4c4b-812b-f5179dfbb5e3 req-14abd94b-02f9-4da0-afcc-89d3a7df0993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae2dce9-30b8-4149-b435-985af792f311", "tag": "fb80c9b4-8ce5-44a6-9088-b8da30f8927e"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:43.155422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-312b5c55-1562-4c4b-812b-f5179dfbb5e3 req-14abd94b-02f9-4da0-afcc-89d3a7df0993 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:43.156906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-312b5c55-1562-4c4b-812b-f5179dfbb5e3 req-14abd94b-02f9-4da0-afcc-89d3a7df0993 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:43.172470 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-312b5c55-1562-4c4b-812b-f5179dfbb5e3 req-14abd94b-02f9-4da0-afcc-89d3a7df0993 service nova] Creating event network-changed:fb80c9b4-8ce5-44a6-9088-b8da30f8927e for instance bae2dce9-30b8-4149-b435-985af792f311 on hv-cinder-83697 Jun 22 12:00:43.178590 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-312b5c55-1562-4c4b-812b-f5179dfbb5e3 req-14abd94b-02f9-4da0-afcc-89d3a7df0993 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040083 Jun 22 12:00:43.179439 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 560/1070] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:43.551284 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d96f4f93-53ad-4588-ab81-3792205ddb70 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:43.552137 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d96f4f93-53ad-4588-ab81-3792205ddb70 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:43.558095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d96f4f93-53ad-4588-ab81-3792205ddb70 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:43.558537 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d96f4f93-53ad-4588-ab81-3792205ddb70 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:43.559293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d96f4f93-53ad-4588-ab81-3792205ddb70 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:43.559749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d96f4f93-53ad-4588-ab81-3792205ddb70 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:43.692599 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d96f4f93-53ad-4588-ab81-3792205ddb70 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:43.700003 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d96f4f93-53ad-4588-ab81-3792205ddb70 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.152648 Jun 22 12:00:43.700559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 511/1071] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:43 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:44.023193 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5179ea94-6301-450e-84c8-3db06d6aa0f5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:44.023937 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5179ea94-6301-450e-84c8-3db06d6aa0f5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:44.030467 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5179ea94-6301-450e-84c8-3db06d6aa0f5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:44.030906 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5179ea94-6301-450e-84c8-3db06d6aa0f5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:44.031687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5179ea94-6301-450e-84c8-3db06d6aa0f5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:44.032114 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5179ea94-6301-450e-84c8-3db06d6aa0f5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:44.164064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5179ea94-6301-450e-84c8-3db06d6aa0f5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:44.170940 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5179ea94-6301-450e-84c8-3db06d6aa0f5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.152255 Jun 22 12:00:44.171521 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 561/1072] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:44 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:44.717101 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-54a507f9-27ba-48a1-ae01-3fd488c35f6c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:44.717731 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-54a507f9-27ba-48a1-ae01-3fd488c35f6c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:44.724409 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-54a507f9-27ba-48a1-ae01-3fd488c35f6c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:44.724862 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-54a507f9-27ba-48a1-ae01-3fd488c35f6c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:44.725628 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-54a507f9-27ba-48a1-ae01-3fd488c35f6c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:44.726058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-54a507f9-27ba-48a1-ae01-3fd488c35f6c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:44.853726 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-54a507f9-27ba-48a1-ae01-3fd488c35f6c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:44.861065 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-54a507f9-27ba-48a1-ae01-3fd488c35f6c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.147835 Jun 22 12:00:44.862160 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 512/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:44 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:45.189087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-19671acd-6da8-44c6-a04d-08024320b943 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:45.189690 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-19671acd-6da8-44c6-a04d-08024320b943 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:45.198123 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19671acd-6da8-44c6-a04d-08024320b943 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:45.198969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19671acd-6da8-44c6-a04d-08024320b943 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:45.200294 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19671acd-6da8-44c6-a04d-08024320b943 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:45.200915 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19671acd-6da8-44c6-a04d-08024320b943 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:45.332632 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-19671acd-6da8-44c6-a04d-08024320b943 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:45.340055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-19671acd-6da8-44c6-a04d-08024320b943 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.154887 Jun 22 12:00:45.340605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 562/1074] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:45 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:45.879087 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-49f401ef-7e78-4343-88cc-3e1a4169985d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:45.879729 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-49f401ef-7e78-4343-88cc-3e1a4169985d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:45.888625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-49f401ef-7e78-4343-88cc-3e1a4169985d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:45.889074 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-49f401ef-7e78-4343-88cc-3e1a4169985d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:45.889878 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-49f401ef-7e78-4343-88cc-3e1a4169985d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:45.890335 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-49f401ef-7e78-4343-88cc-3e1a4169985d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:46.018022 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-49f401ef-7e78-4343-88cc-3e1a4169985d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:46.026422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-49f401ef-7e78-4343-88cc-3e1a4169985d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.151884 Jun 22 12:00:46.026979 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 513/1075] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:45 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:46.357389 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-51c11697-eee9-4678-a7d4-ba8a1f57b352 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:46.357998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-51c11697-eee9-4678-a7d4-ba8a1f57b352 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:46.364919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-51c11697-eee9-4678-a7d4-ba8a1f57b352 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:46.365365 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-51c11697-eee9-4678-a7d4-ba8a1f57b352 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:46.366118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-51c11697-eee9-4678-a7d4-ba8a1f57b352 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:46.366550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-51c11697-eee9-4678-a7d4-ba8a1f57b352 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:46.505573 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-51c11697-eee9-4678-a7d4-ba8a1f57b352 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:46.513050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-51c11697-eee9-4678-a7d4-ba8a1f57b352 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.159557 Jun 22 12:00:46.513610 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 563/1076] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:46 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:47.043065 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-6e1455c1-2e4a-4170-ba01-954ca71d3fba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:47.043693 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-6e1455c1-2e4a-4170-ba01-954ca71d3fba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:47.050106 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e1455c1-2e4a-4170-ba01-954ca71d3fba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:47.050548 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e1455c1-2e4a-4170-ba01-954ca71d3fba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:47.051291 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e1455c1-2e4a-4170-ba01-954ca71d3fba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:47.051744 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-6e1455c1-2e4a-4170-ba01-954ca71d3fba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:47.180767 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-6e1455c1-2e4a-4170-ba01-954ca71d3fba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:47.188239 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-6e1455c1-2e4a-4170-ba01-954ca71d3fba tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.149054 Jun 22 12:00:47.188806 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 514/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:47 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:47.530063 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-3243690b-8aa4-4388-ac73-269da0bc3a07 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:47.530798 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-3243690b-8aa4-4388-ac73-269da0bc3a07 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:47.537890 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3243690b-8aa4-4388-ac73-269da0bc3a07 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:47.538280 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3243690b-8aa4-4388-ac73-269da0bc3a07 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:47.539068 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3243690b-8aa4-4388-ac73-269da0bc3a07 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:47.539546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-3243690b-8aa4-4388-ac73-269da0bc3a07 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:47.666561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-3243690b-8aa4-4388-ac73-269da0bc3a07 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:47.673983 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-3243690b-8aa4-4388-ac73-269da0bc3a07 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.147748 Jun 22 12:00:47.674542 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 564/1078] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:47 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:48.205239 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ee789c6a-98c2-41ae-9a4d-16a5fa57294e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:48.205838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ee789c6a-98c2-41ae-9a4d-16a5fa57294e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:48.213695 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ee789c6a-98c2-41ae-9a4d-16a5fa57294e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:48.214137 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ee789c6a-98c2-41ae-9a4d-16a5fa57294e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:48.214886 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ee789c6a-98c2-41ae-9a4d-16a5fa57294e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:48.215307 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ee789c6a-98c2-41ae-9a4d-16a5fa57294e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:48.347037 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ee789c6a-98c2-41ae-9a4d-16a5fa57294e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:48.354466 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ee789c6a-98c2-41ae-9a4d-16a5fa57294e tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.153059 Jun 22 12:00:48.355015 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 515/1079] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:48 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:48.692039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-08182953-f87c-4ef4-94f2-3e5288b75759 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:48.692647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-08182953-f87c-4ef4-94f2-3e5288b75759 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:48.699049 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08182953-f87c-4ef4-94f2-3e5288b75759 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:48.699527 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08182953-f87c-4ef4-94f2-3e5288b75759 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:48.700291 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08182953-f87c-4ef4-94f2-3e5288b75759 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:48.700716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-08182953-f87c-4ef4-94f2-3e5288b75759 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:48.825786 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-08182953-f87c-4ef4-94f2-3e5288b75759 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:48.833201 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-08182953-f87c-4ef4-94f2-3e5288b75759 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.145693 Jun 22 12:00:48.833781 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 565/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:48 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:49.372185 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-13affe29-0c85-4ebd-889e-5d8e481e0f38 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:49.372937 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-13affe29-0c85-4ebd-889e-5d8e481e0f38 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:49.379737 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13affe29-0c85-4ebd-889e-5d8e481e0f38 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:49.380181 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13affe29-0c85-4ebd-889e-5d8e481e0f38 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:49.380993 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13affe29-0c85-4ebd-889e-5d8e481e0f38 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:49.381421 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-13affe29-0c85-4ebd-889e-5d8e481e0f38 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:49.568323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-13affe29-0c85-4ebd-889e-5d8e481e0f38 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:49.575855 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-13affe29-0c85-4ebd-889e-5d8e481e0f38 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.207619 Jun 22 12:00:49.576503 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 516/1081] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:49 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:49.639730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-338d77c9-04eb-48a3-817d-cde5c9927ebd req-7c633a6b-165c-4f5b-a235-43d44895c266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae2dce9-30b8-4149-b435-985af792f311", "name": "network-vif-plugged", "status": "completed", "tag": "fb80c9b4-8ce5-44a6-9088-b8da30f8927e"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:49.648618 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-338d77c9-04eb-48a3-817d-cde5c9927ebd req-7c633a6b-165c-4f5b-a235-43d44895c266 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:49.649061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-338d77c9-04eb-48a3-817d-cde5c9927ebd req-7c633a6b-165c-4f5b-a235-43d44895c266 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:49.660112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-338d77c9-04eb-48a3-817d-cde5c9927ebd req-7c633a6b-165c-4f5b-a235-43d44895c266 service nova] Creating event network-vif-plugged:fb80c9b4-8ce5-44a6-9088-b8da30f8927e for instance bae2dce9-30b8-4149-b435-985af792f311 on hv-cinder-83697 Jun 22 12:00:49.665458 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-338d77c9-04eb-48a3-817d-cde5c9927ebd req-7c633a6b-165c-4f5b-a235-43d44895c266 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029562 Jun 22 12:00:49.666339 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 566/1082] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:49.849929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ac1669d9-29c7-4b2c-b175-549e55028c9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:49.850527 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ac1669d9-29c7-4b2c-b175-549e55028c9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:49.856414 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ac1669d9-29c7-4b2c-b175-549e55028c9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:49.856849 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ac1669d9-29c7-4b2c-b175-549e55028c9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:49.857591 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ac1669d9-29c7-4b2c-b175-549e55028c9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:49.858020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ac1669d9-29c7-4b2c-b175-549e55028c9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:49.989495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-ac1669d9-29c7-4b2c-b175-549e55028c9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:49.996816 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ac1669d9-29c7-4b2c-b175-549e55028c9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.150773 Jun 22 12:00:49.997367 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 517/1083] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:49 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:50.591206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:50.591997 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=8 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:50.596417 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d98702d1-ddc8-4252-a430-0548c0cecdee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:50.597680 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d98702d1-ddc8-4252-a430-0548c0cecdee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:50.604642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d98702d1-ddc8-4252-a430-0548c0cecdee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:50.605091 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d98702d1-ddc8-4252-a430-0548c0cecdee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:50.605847 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d98702d1-ddc8-4252-a430-0548c0cecdee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:50.606283 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d98702d1-ddc8-4252-a430-0548c0cecdee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:50.734623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d98702d1-ddc8-4252-a430-0548c0cecdee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:50.742068 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d98702d1-ddc8-4252-a430-0548c0cecdee tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.152293 Jun 22 12:00:50.742625 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 567/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:50 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:51.014150 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-76e34d56-6834-4987-a942-77f6399624cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:51.014749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-76e34d56-6834-4987-a942-77f6399624cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:51.017071 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=12 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:51.022763 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76e34d56-6834-4987-a942-77f6399624cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:51.023204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76e34d56-6834-4987-a942-77f6399624cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:51.023970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76e34d56-6834-4987-a942-77f6399624cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:51.024398 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-76e34d56-6834-4987-a942-77f6399624cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:51.154096 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-76e34d56-6834-4987-a942-77f6399624cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:51.161407 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-76e34d56-6834-4987-a942-77f6399624cc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.151136 Jun 22 12:00:51.161987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 518/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:51 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:51.759224 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7a6ff64f-0aff-44a1-a487-db6a64599285 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:51.759845 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7a6ff64f-0aff-44a1-a487-db6a64599285 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:51.766217 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7a6ff64f-0aff-44a1-a487-db6a64599285 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:51.766655 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7a6ff64f-0aff-44a1-a487-db6a64599285 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:51.767433 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7a6ff64f-0aff-44a1-a487-db6a64599285 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:51.767862 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7a6ff64f-0aff-44a1-a487-db6a64599285 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:51.787715 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-2d491446-8b69-48d6-b4ac-a0b9c3327e44 req-440142c7-4aec-41b9-9b0e-77010281724d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5", "name": "network-vif-plugged", "status": "completed", "tag": "9d063124-fca9-4ccc-a48c-caf8bf3ca42b"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:51.801664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-2d491446-8b69-48d6-b4ac-a0b9c3327e44 req-440142c7-4aec-41b9-9b0e-77010281724d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:51.803274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-2d491446-8b69-48d6-b4ac-a0b9c3327e44 req-440142c7-4aec-41b9-9b0e-77010281724d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:51.815402 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-2d491446-8b69-48d6-b4ac-a0b9c3327e44 req-440142c7-4aec-41b9-9b0e-77010281724d service nova] Creating event network-vif-plugged:9d063124-fca9-4ccc-a48c-caf8bf3ca42b for instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 on hv-cinder-83697 Jun 22 12:00:51.820663 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-2d491446-8b69-48d6-b4ac-a0b9c3327e44 req-440142c7-4aec-41b9-9b0e-77010281724d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038309 Jun 22 12:00:51.821551 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 519/1086] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:51.902826 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7a6ff64f-0aff-44a1-a487-db6a64599285 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:51.910744 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7a6ff64f-0aff-44a1-a487-db6a64599285 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.154885 Jun 22 12:00:51.911298 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 568/1087] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:51 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:52.178738 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b8dff299-64b3-437f-ab0b-34ff3c0be046 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:52.179413 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b8dff299-64b3-437f-ab0b-34ff3c0be046 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:52.186102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8dff299-64b3-437f-ab0b-34ff3c0be046 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:52.186748 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8dff299-64b3-437f-ab0b-34ff3c0be046 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:52.187545 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8dff299-64b3-437f-ab0b-34ff3c0be046 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:52.187980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b8dff299-64b3-437f-ab0b-34ff3c0be046 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:52.317052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b8dff299-64b3-437f-ab0b-34ff3c0be046 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:52.325773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b8dff299-64b3-437f-ab0b-34ff3c0be046 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1366 microversion: 2.1 time: 0.151337 Jun 22 12:00:52.327667 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 520/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:52 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:52.927715 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-918be4ad-fdd8-406c-a762-4a3776c2a5c1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:52.928317 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-918be4ad-fdd8-406c-a762-4a3776c2a5c1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:52.934761 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-918be4ad-fdd8-406c-a762-4a3776c2a5c1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:52.935310 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-918be4ad-fdd8-406c-a762-4a3776c2a5c1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:52.936096 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-918be4ad-fdd8-406c-a762-4a3776c2a5c1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:52.936525 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-918be4ad-fdd8-406c-a762-4a3776c2a5c1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:53.062207 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-918be4ad-fdd8-406c-a762-4a3776c2a5c1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:53.069528 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-918be4ad-fdd8-406c-a762-4a3776c2a5c1 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.145878 Jun 22 12:00:53.070087 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 569/1089] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:52 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:53.342554 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-73fc6f99-941e-4a1a-bd2e-f58ec05ac85e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:53.343102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-73fc6f99-941e-4a1a-bd2e-f58ec05ac85e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:53.349447 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73fc6f99-941e-4a1a-bd2e-f58ec05ac85e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:53.349889 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73fc6f99-941e-4a1a-bd2e-f58ec05ac85e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:53.350627 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73fc6f99-941e-4a1a-bd2e-f58ec05ac85e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:53.351049 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-73fc6f99-941e-4a1a-bd2e-f58ec05ac85e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:53.477031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-73fc6f99-941e-4a1a-bd2e-f58ec05ac85e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:53.484428 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-73fc6f99-941e-4a1a-bd2e-f58ec05ac85e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1555 microversion: 2.1 time: 0.145821 Jun 22 12:00:53.484977 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 521/1090] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:53 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:53.500603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-bdaaf5ed-9702-4b73-8be7-4bf54db30719 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:53.501089 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-bdaaf5ed-9702-4b73-8be7-4bf54db30719 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:53.507434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bdaaf5ed-9702-4b73-8be7-4bf54db30719 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:53.507874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bdaaf5ed-9702-4b73-8be7-4bf54db30719 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:53.508615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bdaaf5ed-9702-4b73-8be7-4bf54db30719 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:53.509055 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-bdaaf5ed-9702-4b73-8be7-4bf54db30719 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:53.512543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:53.591685 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-bdaaf5ed-9702-4b73-8be7-4bf54db30719 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094839 Jun 22 12:00:53.592270 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 570/1091] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 12:00:53 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:00:54.086655 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-8d9a8261-ccb0-4292-be48-95e3e040f896 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:54.087266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-8d9a8261-ccb0-4292-be48-95e3e040f896 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:54.093192 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8d9a8261-ccb0-4292-be48-95e3e040f896 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:54.093634 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8d9a8261-ccb0-4292-be48-95e3e040f896 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:54.094420 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8d9a8261-ccb0-4292-be48-95e3e040f896 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:54.094851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-8d9a8261-ccb0-4292-be48-95e3e040f896 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:54.112544 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=100 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:00:54.312174 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-8d9a8261-ccb0-4292-be48-95e3e040f896 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:54.320059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-8d9a8261-ccb0-4292-be48-95e3e040f896 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1264 microversion: 2.1 time: 0.237904 Jun 22 12:00:54.320618 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 522/1092] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:54 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 12:00:54.565658 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-b8bb7de5-c1fa-4c7b-9eee-0402f13c3c20 req-75067ace-ffb9-439f-9748-c59a32e287a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae2dce9-30b8-4149-b435-985af792f311", "tag": "fb80c9b4-8ce5-44a6-9088-b8da30f8927e"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:54.573640 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-b8bb7de5-c1fa-4c7b-9eee-0402f13c3c20 req-75067ace-ffb9-439f-9748-c59a32e287a8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:54.574081 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-b8bb7de5-c1fa-4c7b-9eee-0402f13c3c20 req-75067ace-ffb9-439f-9748-c59a32e287a8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:54.585339 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-b8bb7de5-c1fa-4c7b-9eee-0402f13c3c20 req-75067ace-ffb9-439f-9748-c59a32e287a8 service nova] Creating event network-changed:fb80c9b4-8ce5-44a6-9088-b8da30f8927e for instance bae2dce9-30b8-4149-b435-985af792f311 on hv-cinder-83697 Jun 22 12:00:54.590277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-b8bb7de5-c1fa-4c7b-9eee-0402f13c3c20 req-75067ace-ffb9-439f-9748-c59a32e287a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028833 Jun 22 12:00:54.591031 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 571/1093] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 12:00:55.337711 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5063fe8b-e59f-446f-a026-3375e643e42a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:55.338318 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-5063fe8b-e59f-446f-a026-3375e643e42a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:55.345184 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5063fe8b-e59f-446f-a026-3375e643e42a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:55.345629 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5063fe8b-e59f-446f-a026-3375e643e42a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:55.346418 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5063fe8b-e59f-446f-a026-3375e643e42a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:55.346851 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-5063fe8b-e59f-446f-a026-3375e643e42a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:55.480742 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-5063fe8b-e59f-446f-a026-3375e643e42a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:55.488331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5063fe8b-e59f-446f-a026-3375e643e42a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1451 microversion: 2.1 time: 0.155210 Jun 22 12:00:55.489142 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 523/1094] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:55 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:55.505344 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5ce7c4f3-7a9c-41c7-96cc-533d2d6e8994 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:00:55.506044 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5ce7c4f3-7a9c-41c7-96cc-533d2d6e8994 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:00:55.512173 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5ce7c4f3-7a9c-41c7-96cc-533d2d6e8994 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:55.512623 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5ce7c4f3-7a9c-41c7-96cc-533d2d6e8994 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:55.513380 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5ce7c4f3-7a9c-41c7-96cc-533d2d6e8994 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:55.513811 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5ce7c4f3-7a9c-41c7-96cc-533d2d6e8994 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:55.907683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-5ce7c4f3-7a9c-41c7-96cc-533d2d6e8994 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:00:55.915898 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5ce7c4f3-7a9c-41c7-96cc-533d2d6e8994 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1451 microversion: 2.1 time: 0.415192 Jun 22 12:00:55.916494 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 572/1095] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:00:55 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1451 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:00:57.571927 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-127d905d-fc06-4777-a40b-746e7f98b929 req-952e2219-db90-4fde-a1ce-81e5d546d553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5", "tag": "9d063124-fca9-4ccc-a48c-caf8bf3ca42b"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:00:57.580210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-127d905d-fc06-4777-a40b-746e7f98b929 req-952e2219-db90-4fde-a1ce-81e5d546d553 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:00:57.580643 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-127d905d-fc06-4777-a40b-746e7f98b929 req-952e2219-db90-4fde-a1ce-81e5d546d553 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:00:57.592164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-127d905d-fc06-4777-a40b-746e7f98b929 req-952e2219-db90-4fde-a1ce-81e5d546d553 service nova] Creating event network-changed:9d063124-fca9-4ccc-a48c-caf8bf3ca42b for instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 on hv-cinder-83697 Jun 22 12:00:57.597330 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-127d905d-fc06-4777-a40b-746e7f98b929 req-952e2219-db90-4fde-a1ce-81e5d546d553 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029617 Jun 22 12:00:57.598181 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 524/1096] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 12:02:24.090852 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:24.091619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=10 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:24.096232 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-5729596c-9712-4452-a964-40c4c0fef949 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:24.096718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-5729596c-9712-4452-a964-40c4c0fef949 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:24.104238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5729596c-9712-4452-a964-40c4c0fef949 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:24.104684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5729596c-9712-4452-a964-40c4c0fef949 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:24.105440 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5729596c-9712-4452-a964-40c4c0fef949 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:24.105874 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-5729596c-9712-4452-a964-40c4c0fef949 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:24.128857 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-5729596c-9712-4452-a964-40c4c0fef949 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311/ips" status: 200 len: 148 microversion: 2.1 time: 0.039875 Jun 22 12:02:24.129410 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 573/1097] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 12:02:24 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:24.138337 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:24.139567 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=10 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:24.144980 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a944c699-214a-4baf-b0e3-7d75398e1b61"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:24.146108 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:24.153927 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:24.154372 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:24.155132 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:24.156088 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:24.235425 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Invalid volume: volume a944c699-214a-4baf-b0e3-7d75398e1b61 is already attached to instances: 58808877-ad76-46f6-9d87-ad3620eaa37b Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: POST /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311/os-volume_attachments HTTP/1.1 Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 74 Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:02:24.237144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {"volumeAttachment": {"volumeId": "a944c699-214a-4baf-b0e3-7d75398e1b61"}} Jun 22 12:02:24.238840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Invalid volume: volume a944c699-214a-4baf-b0e3-7d75398e1b61 is already attached to instances: 58808877-ad76-46f6-9d87-ad3620eaa37b Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'server_id': 'bae2dce9-30b8-4149-b435-985af792f311', 'body': {'volumeAttachment': {'volumeId': 'a944c699-214a-4baf-b0e3-7d75398e1b61'}}} Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a944c699-214a-4baf-b0e3-7d75398e1b61 is already attached to instances: 58808877-ad76-46f6-9d87-ad3620eaa37b Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:24.239773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a944c699-214a-4baf-b0e3-7d75398e1b61 is already attached to instances: 58808877-ad76-46f6-9d87-ad3620eaa37b Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:24.241325 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:02:24.243038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:02:24.243038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:02:24.243038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:02:24.243038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a944c699-214a-4baf-b0e3-7d75398e1b61 is already attached to instances: 58808877-ad76-46f6-9d87-ad3620eaa37b Jun 22 12:02:24.243038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:24.243038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 400 to user: Invalid volume: volume a944c699-214a-4baf-b0e3-7d75398e1b61 is already attached to instances: 58808877-ad76-46f6-9d87-ad3620eaa37b {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:02:24.243038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f7415fcc-d30e-4ab7-bbb3-c54da020e287 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102727 Jun 22 12:02:24.243038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 525/1098] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 12:02:24 2022] POST /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 12:02:24.247081 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-218501ae-adce-4cd8-b922-3f6a05b8031a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:24.247618 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-218501ae-adce-4cd8-b922-3f6a05b8031a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:24.253720 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-218501ae-adce-4cd8-b922-3f6a05b8031a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:24.254163 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-218501ae-adce-4cd8-b922-3f6a05b8031a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:24.254929 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-218501ae-adce-4cd8-b922-3f6a05b8031a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:24.255342 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-218501ae-adce-4cd8-b922-3f6a05b8031a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:24.279716 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-218501ae-adce-4cd8-b922-3f6a05b8031a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 12:02:24.354001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-218501ae-adce-4cd8-b922-3f6a05b8031a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 204 len: 0 microversion: 2.1 time: 0.110429 Jun 22 12:02:24.354571 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 574/1099] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:02:24 2022] DELETE /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 12:02:24.363145 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3df8acc0-862b-4ded-a2bf-72eb71925817 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:24.363770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3df8acc0-862b-4ded-a2bf-72eb71925817 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:24.370490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3df8acc0-862b-4ded-a2bf-72eb71925817 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:24.370927 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3df8acc0-862b-4ded-a2bf-72eb71925817 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:24.371692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3df8acc0-862b-4ded-a2bf-72eb71925817 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:24.372120 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3df8acc0-862b-4ded-a2bf-72eb71925817 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:24.502675 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3df8acc0-862b-4ded-a2bf-72eb71925817 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:24.510040 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3df8acc0-862b-4ded-a2bf-72eb71925817 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1679 microversion: 2.1 time: 0.151371 Jun 22 12:02:24.510610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 526/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:24 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:25.528648 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-64d97da5-0eb9-433b-b44c-ebb7d59d8f71 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:25.529361 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-64d97da5-0eb9-433b-b44c-ebb7d59d8f71 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:25.535872 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-64d97da5-0eb9-433b-b44c-ebb7d59d8f71 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:25.536316 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-64d97da5-0eb9-433b-b44c-ebb7d59d8f71 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:25.537070 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-64d97da5-0eb9-433b-b44c-ebb7d59d8f71 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:25.537502 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-64d97da5-0eb9-433b-b44c-ebb7d59d8f71 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:25.666735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-64d97da5-0eb9-433b-b44c-ebb7d59d8f71 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:25.674825 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-64d97da5-0eb9-433b-b44c-ebb7d59d8f71 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1679 microversion: 2.1 time: 0.150443 Jun 22 12:02:25.675399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 575/1101] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:25 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:26.691479 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-11cc9519-0ade-4786-8f17-a3650cb28536 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:26.692086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-11cc9519-0ade-4786-8f17-a3650cb28536 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:26.698425 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11cc9519-0ade-4786-8f17-a3650cb28536 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:26.698870 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11cc9519-0ade-4786-8f17-a3650cb28536 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:26.699659 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11cc9519-0ade-4786-8f17-a3650cb28536 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:26.700091 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-11cc9519-0ade-4786-8f17-a3650cb28536 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:26.939454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-11cc9519-0ade-4786-8f17-a3650cb28536 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:26.947246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-11cc9519-0ade-4786-8f17-a3650cb28536 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 200 len: 1679 microversion: 2.1 time: 0.259701 Jun 22 12:02:26.947850 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 527/1102] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:26 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:27.205653 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-4957885b-6df8-4109-9c5b-6ba2d04c6df5 req-e6004e19-3523-42df-beaf-150d5e53a695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae2dce9-30b8-4149-b435-985af792f311", "name": "network-vif-deleted", "tag": "fb80c9b4-8ce5-44a6-9088-b8da30f8927e"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:27.217547 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-4957885b-6df8-4109-9c5b-6ba2d04c6df5 req-e6004e19-3523-42df-beaf-150d5e53a695 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:27.218624 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-4957885b-6df8-4109-9c5b-6ba2d04c6df5 req-e6004e19-3523-42df-beaf-150d5e53a695 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:27.233768 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-4957885b-6df8-4109-9c5b-6ba2d04c6df5 req-e6004e19-3523-42df-beaf-150d5e53a695 service nova] Creating event network-vif-deleted:fb80c9b4-8ce5-44a6-9088-b8da30f8927e for instance bae2dce9-30b8-4149-b435-985af792f311 on hv-cinder-83697 Jun 22 12:02:27.244271 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-4957885b-6df8-4109-9c5b-6ba2d04c6df5 req-e6004e19-3523-42df-beaf-150d5e53a695 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043167 Jun 22 12:02:27.245463 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 576/1103] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:27.964105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:27.964717 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:27.972052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:27.972494 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:27.973254 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:27.973683 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:27.988031 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 HTTP/1.1 Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:02:27.989572 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:02:27.991249 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'bae2dce9-30b8-4149-b435-985af792f311'} Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:02:27.992089 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:02:27.993611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:27.995105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:02:27.995105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2f47de73-d686-45b4-aeb6-df29ed762c94 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 404 len: 111 microversion: 2.1 time: 0.030760 Jun 22 12:02:27.995105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 528/1104] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:27 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:02:28.000832 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-109bb25c-a96a-48a2-b8ba-9bf7ae7eda39 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '.version_select at 0x7f3ea821c4c0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:28.003998 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR oslo.messaging._drivers.impl_rabbit [None req-109bb25c-a96a-48a2-b8ba-9bf7ae7eda39 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [54807073-ede7-405f-bd5a-13230c26c203] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 12:02:29.012220 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [None req-109bb25c-a96a-48a2-b8ba-9bf7ae7eda39 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [54807073-ede7-405f-bd5a-13230c26c203] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 53634. Jun 22 12:02:29.030388 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-109bb25c-a96a-48a2-b8ba-9bf7ae7eda39 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-900987100" status: 202 len: 0 microversion: 2.1 time: 1.033752 Jun 22 12:02:29.030991 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 577/1105] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Jun 22 12:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-900987100 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:02:29.664047 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-21a3cb42-c0c4-4ee8-9812-3ef0983d0259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:29.664567 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-21a3cb42-c0c4-4ee8-9812-3ef0983d0259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:29.670782 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-21a3cb42-c0c4-4ee8-9812-3ef0983d0259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:29.671864 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-21a3cb42-c0c4-4ee8-9812-3ef0983d0259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:29.672610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-21a3cb42-c0c4-4ee8-9812-3ef0983d0259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:29.673037 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-21a3cb42-c0c4-4ee8-9812-3ef0983d0259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:29.752777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-21a3cb42-c0c4-4ee8-9812-3ef0983d0259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lazy-loading 'services' on Instance uuid 58808877-ad76-46f6-9d87-ad3620eaa37b {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 12:02:29.863310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-21a3cb42-c0c4-4ee8-9812-3ef0983d0259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-volume_attachments/a944c699-214a-4baf-b0e3-7d75398e1b61" status: 202 len: 0 microversion: 2.1 time: 0.202966 Jun 22 12:02:29.863911 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 529/1106] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 12:02:29 2022] DELETE /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-volume_attachments/a944c699-214a-4baf-b0e3-7d75398e1b61 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:02:29.872605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-309b94c4-0461-4b29-b58b-44daaba2aa9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:29.873622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-309b94c4-0461-4b29-b58b-44daaba2aa9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:29.880488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-309b94c4-0461-4b29-b58b-44daaba2aa9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:29.881044 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-309b94c4-0461-4b29-b58b-44daaba2aa9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:29.881846 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-309b94c4-0461-4b29-b58b-44daaba2aa9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:29.882311 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-309b94c4-0461-4b29-b58b-44daaba2aa9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:29.918287 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-309b94c4-0461-4b29-b58b-44daaba2aa9b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049945 Jun 22 12:02:29.918869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 578/1107] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 12:02:29 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:30.930915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ad7f7d52-7319-4b34-a9fe-feeaf579193e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:30.932035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-ad7f7d52-7319-4b34-a9fe-feeaf579193e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:30.938825 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ad7f7d52-7319-4b34-a9fe-feeaf579193e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:30.939541 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ad7f7d52-7319-4b34-a9fe-feeaf579193e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:30.940314 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ad7f7d52-7319-4b34-a9fe-feeaf579193e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:30.940756 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-ad7f7d52-7319-4b34-a9fe-feeaf579193e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:30.970751 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ad7f7d52-7319-4b34-a9fe-feeaf579193e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044291 Jun 22 12:02:30.971311 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 530/1108] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 12:02:30 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 12:02:31.028040 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-eaf1fec8-9b00-4888-8caa-2dc3b302a4dd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:31.028566 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-eaf1fec8-9b00-4888-8caa-2dc3b302a4dd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:31.035449 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eaf1fec8-9b00-4888-8caa-2dc3b302a4dd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:31.035895 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eaf1fec8-9b00-4888-8caa-2dc3b302a4dd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:31.036647 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eaf1fec8-9b00-4888-8caa-2dc3b302a4dd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:31.037078 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eaf1fec8-9b00-4888-8caa-2dc3b302a4dd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:31.061572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-eaf1fec8-9b00-4888-8caa-2dc3b302a4dd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 12:02:31.134470 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-eaf1fec8-9b00-4888-8caa-2dc3b302a4dd tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 204 len: 0 microversion: 2.1 time: 0.109955 Jun 22 12:02:31.135051 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 579/1109] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:02:31 2022] DELETE /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 12:02:31.144223 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-62ff1c8a-89cb-41a0-9f34-6db7fd504ff4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:31.144894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-62ff1c8a-89cb-41a0-9f34-6db7fd504ff4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:31.151397 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62ff1c8a-89cb-41a0-9f34-6db7fd504ff4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:31.151848 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62ff1c8a-89cb-41a0-9f34-6db7fd504ff4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:31.152633 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62ff1c8a-89cb-41a0-9f34-6db7fd504ff4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:31.153119 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62ff1c8a-89cb-41a0-9f34-6db7fd504ff4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:31.281875 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-62ff1c8a-89cb-41a0-9f34-6db7fd504ff4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:31.289287 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-62ff1c8a-89cb-41a0-9f34-6db7fd504ff4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1680 microversion: 2.1 time: 0.149973 Jun 22 12:02:31.289847 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 531/1110] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:31 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:32.307288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-acb8f9d9-c973-4286-b64b-3910d7a37e0d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:32.308037 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-acb8f9d9-c973-4286-b64b-3910d7a37e0d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:32.314851 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-acb8f9d9-c973-4286-b64b-3910d7a37e0d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:32.315300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-acb8f9d9-c973-4286-b64b-3910d7a37e0d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:32.316102 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-acb8f9d9-c973-4286-b64b-3910d7a37e0d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:32.316553 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-acb8f9d9-c973-4286-b64b-3910d7a37e0d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:32.448352 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-acb8f9d9-c973-4286-b64b-3910d7a37e0d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:32.455713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-acb8f9d9-c973-4286-b64b-3910d7a37e0d tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1680 microversion: 2.1 time: 0.152682 Jun 22 12:02:32.456258 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 580/1111] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:32 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:33.472986 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-de30db4f-8e2e-44a7-b6c1-4bb0c9ccfe5b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:33.473592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-de30db4f-8e2e-44a7-b6c1-4bb0c9ccfe5b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:33.479692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de30db4f-8e2e-44a7-b6c1-4bb0c9ccfe5b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:33.480136 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de30db4f-8e2e-44a7-b6c1-4bb0c9ccfe5b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:33.480894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de30db4f-8e2e-44a7-b6c1-4bb0c9ccfe5b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:33.481321 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-de30db4f-8e2e-44a7-b6c1-4bb0c9ccfe5b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:33.719032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-de30db4f-8e2e-44a7-b6c1-4bb0c9ccfe5b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:33.727701 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-de30db4f-8e2e-44a7-b6c1-4bb0c9ccfe5b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 200 len: 1680 microversion: 2.1 time: 0.258574 Jun 22 12:02:33.728272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 532/1112] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:33 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:34.214855 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-278301de-0481-465d-9687-0855144f4a22 req-1efdfc72-310c-44fb-86a6-4c06b04ad4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58808877-ad76-46f6-9d87-ad3620eaa37b", "name": "network-vif-deleted", "tag": "d630e829-11cc-4aeb-bc02-c8af1cfc5f81"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:34.226829 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-278301de-0481-465d-9687-0855144f4a22 req-1efdfc72-310c-44fb-86a6-4c06b04ad4c8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:34.227381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-278301de-0481-465d-9687-0855144f4a22 req-1efdfc72-310c-44fb-86a6-4c06b04ad4c8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:34.240113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-278301de-0481-465d-9687-0855144f4a22 req-1efdfc72-310c-44fb-86a6-4c06b04ad4c8 service nova] Creating event network-vif-deleted:d630e829-11cc-4aeb-bc02-c8af1cfc5f81 for instance 58808877-ad76-46f6-9d87-ad3620eaa37b on hv-cinder-83697 Jun 22 12:02:34.246480 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-278301de-0481-465d-9687-0855144f4a22 req-1efdfc72-310c-44fb-86a6-4c06b04ad4c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036542 Jun 22 12:02:34.247181 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 581/1113] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:34.746020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:34.746571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:34.753621 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:34.754058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:34.754846 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:34.755268 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:34.769611 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b HTTP/1.1 Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:02:34.771256 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:02:34.773016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '58808877-ad76-46f6-9d87-ad3620eaa37b'} Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:02:34.773800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:02:34.775082 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:02:34.776331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:02:34.776331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d2844924-dc0d-40f4-84e4-572f5d5dddf8 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 404 len: 111 microversion: 2.1 time: 0.030882 Jun 22 12:02:34.776331 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 533/1114] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:34 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 12:02:34.782860 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4d66d213-b71c-42c9-ae28-4a54b1500964 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '.version_select at 0x7f3ea836eb80>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:34.800809 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4d66d213-b71c-42c9-ae28-4a54b1500964 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311917456" status: 202 len: 0 microversion: 2.1 time: 0.021996 Jun 22 12:02:34.801383 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 582/1115] 10.222.0.36 () {58 vars in 1220 bytes} [Wed Jun 22 12:02:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311917456 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:02:35.675264 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-ff661782-87da-4912-bd66-d5c949f89bcc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: .version_select at 0x7f3ea835eb80>, body: {"keypair": {"name": "tempest-keypair-590182048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwe4tJtMBzS0OMbaS4eFQDGh+wH6jCD2zXUzxvKC/2wst594S0rTh+TJu/CeyvkFV/mutLCB77g2/xgRfFUsCcFTWyxQG8lgSOsmsl00wrCOjPMEF/OEB17RTx502eSPw=="}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:35.688949 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-ff661782-87da-4912-bd66-d5c949f89bcc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for project 897ec8bf954c41648da9cac00bc44749. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:02:35.692667 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-ff661782-87da-4912-bd66-d5c949f89bcc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for user f2d34a97831f4a7c885ebe64aecb3669 and project 897ec8bf954c41648da9cac00bc44749. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:02:35.713767 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-ff661782-87da-4912-bd66-d5c949f89bcc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042383 Jun 22 12:02:35.714326 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 534/1116] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 12:02:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:37.176236 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-28937474", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c591d2a-1888-4ad8-90c9-cd1f4c969134"}], "security_groups": [{"name": "tempest-securitygroup--58823602"}], "key_name": "tempest-keypair-590182048", "user_data": "}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:37.275922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] validate_networks() for [('0c591d2a-1888-4ad8-90c9-cd1f4c969134', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 12:02:37.637099 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 12:02:37.637557 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 12:02:37.638058 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 12:02:37.638468 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 12:02:37.638877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 12:02:37.647928 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:37.648402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:37.649171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:37.649608 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:37.666964 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for project 897ec8bf954c41648da9cac00bc44749. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:02:37.670927 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for user f2d34a97831f4a7c885ebe64aecb3669 and project 897ec8bf954c41648da9cac00bc44749. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:02:37.682445 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 12:02:37.684816 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 12:02:37.729377 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0d4bfda9-1b38-4791-91df-7064265702fb tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.558586 Jun 22 12:02:37.730020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 583/1117] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 12:02:37 2022] POST /compute/v2.1/servers => generated 400 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 12:02:37.741214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9563221b-561a-4b82-a64c-fe9defa87548 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:37.741976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9563221b-561a-4b82-a64c-fe9defa87548 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:37.795479 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9563221b-561a-4b82-a64c-fe9defa87548 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:37.803115 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9563221b-561a-4b82-a64c-fe9defa87548 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1239 microversion: 2.1 time: 0.066318 Jun 22 12:02:37.803730 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 535/1118] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:37 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:38.821294 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1c756248-5803-4956-a1f4-baa70c02d89e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:38.822090 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1c756248-5803-4956-a1f4-baa70c02d89e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:38.829806 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1c756248-5803-4956-a1f4-baa70c02d89e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:38.830601 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1c756248-5803-4956-a1f4-baa70c02d89e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:38.831388 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1c756248-5803-4956-a1f4-baa70c02d89e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:38.831823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1c756248-5803-4956-a1f4-baa70c02d89e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:38.912437 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1c756248-5803-4956-a1f4-baa70c02d89e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:38.921264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1c756248-5803-4956-a1f4-baa70c02d89e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1299 microversion: 2.1 time: 0.104641 Jun 22 12:02:38.921993 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 584/1119] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:38 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:39.938349 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b13a113c-ee8c-4428-801b-65ea3e199099 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:39.938987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b13a113c-ee8c-4428-801b-65ea3e199099 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:39.945804 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13a113c-ee8c-4428-801b-65ea3e199099 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:39.946258 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13a113c-ee8c-4428-801b-65ea3e199099 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:39.947204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13a113c-ee8c-4428-801b-65ea3e199099 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:39.947670 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13a113c-ee8c-4428-801b-65ea3e199099 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:40.139761 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b13a113c-ee8c-4428-801b-65ea3e199099 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:40.149442 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b13a113c-ee8c-4428-801b-65ea3e199099 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1363 microversion: 2.1 time: 0.215158 Jun 22 12:02:40.150302 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 536/1120] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:39 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:40.439211 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-9a2717e7-daf6-40a6-a2f2-42619fcbb68e req-c8afa107-f69d-45c0-8d26-b995127a62b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d5f19a-cb48-42bb-a04d-07d266334096", "tag": "5ca10698-a742-41b2-9164-7aa7a8bd0795"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:40.450364 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-9a2717e7-daf6-40a6-a2f2-42619fcbb68e req-c8afa107-f69d-45c0-8d26-b995127a62b5 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:40.450961 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-9a2717e7-daf6-40a6-a2f2-42619fcbb68e req-c8afa107-f69d-45c0-8d26-b995127a62b5 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:40.463470 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-9a2717e7-daf6-40a6-a2f2-42619fcbb68e req-c8afa107-f69d-45c0-8d26-b995127a62b5 service nova] Creating event network-changed:5ca10698-a742-41b2-9164-7aa7a8bd0795 for instance c3d5f19a-cb48-42bb-a04d-07d266334096 on hv-cinder-83697 Jun 22 12:02:40.469510 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-9a2717e7-daf6-40a6-a2f2-42619fcbb68e req-c8afa107-f69d-45c0-8d26-b995127a62b5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036955 Jun 22 12:02:40.472928 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 585/1121] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:41.169128 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-589fa81d-3a26-4f75-92d4-3d7eebac58d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:41.169743 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-589fa81d-3a26-4f75-92d4-3d7eebac58d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:41.178102 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589fa81d-3a26-4f75-92d4-3d7eebac58d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:41.178573 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589fa81d-3a26-4f75-92d4-3d7eebac58d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:41.179343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589fa81d-3a26-4f75-92d4-3d7eebac58d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:41.179797 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589fa81d-3a26-4f75-92d4-3d7eebac58d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:41.308993 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-589fa81d-3a26-4f75-92d4-3d7eebac58d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:41.316828 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-589fa81d-3a26-4f75-92d4-3d7eebac58d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1363 microversion: 2.1 time: 0.151613 Jun 22 12:02:41.317387 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 537/1122] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:41 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:42.335730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-71c66c12-8abd-47bc-9ca2-7b94c57b63cf tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:42.336338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-71c66c12-8abd-47bc-9ca2-7b94c57b63cf tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:42.342465 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-71c66c12-8abd-47bc-9ca2-7b94c57b63cf tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:42.342904 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-71c66c12-8abd-47bc-9ca2-7b94c57b63cf tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:42.343670 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-71c66c12-8abd-47bc-9ca2-7b94c57b63cf tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:42.344101 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-71c66c12-8abd-47bc-9ca2-7b94c57b63cf tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:42.474615 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-71c66c12-8abd-47bc-9ca2-7b94c57b63cf tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:42.482022 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-71c66c12-8abd-47bc-9ca2-7b94c57b63cf tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1363 microversion: 2.1 time: 0.151073 Jun 22 12:02:42.482581 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 586/1123] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:42 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:43.499153 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e8aea089-a44d-4f31-a75c-739d6ff909b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:43.499780 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e8aea089-a44d-4f31-a75c-739d6ff909b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:43.506204 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8aea089-a44d-4f31-a75c-739d6ff909b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:43.506667 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8aea089-a44d-4f31-a75c-739d6ff909b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:43.507713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8aea089-a44d-4f31-a75c-739d6ff909b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:43.507877 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8aea089-a44d-4f31-a75c-739d6ff909b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:43.705753 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e8aea089-a44d-4f31-a75c-739d6ff909b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:43.713286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e8aea089-a44d-4f31-a75c-739d6ff909b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1363 microversion: 2.1 time: 0.217947 Jun 22 12:02:43.713854 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 538/1124] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:43 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:44.730166 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-408f1db5-93d7-45c1-8c1f-e87945676d43 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:44.730766 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-408f1db5-93d7-45c1-8c1f-e87945676d43 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:44.737257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-408f1db5-93d7-45c1-8c1f-e87945676d43 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:44.737700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-408f1db5-93d7-45c1-8c1f-e87945676d43 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:44.738450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-408f1db5-93d7-45c1-8c1f-e87945676d43 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:44.738877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-408f1db5-93d7-45c1-8c1f-e87945676d43 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:44.877887 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-408f1db5-93d7-45c1-8c1f-e87945676d43 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:44.885296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-408f1db5-93d7-45c1-8c1f-e87945676d43 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1363 microversion: 2.1 time: 0.158938 Jun 22 12:02:44.885848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 587/1125] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:44 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:45.902918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-528388fa-a550-404a-8b1d-b3ceea662f14 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:45.903555 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-528388fa-a550-404a-8b1d-b3ceea662f14 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:45.910575 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-528388fa-a550-404a-8b1d-b3ceea662f14 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:45.911021 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-528388fa-a550-404a-8b1d-b3ceea662f14 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:45.911796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-528388fa-a550-404a-8b1d-b3ceea662f14 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:45.912228 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-528388fa-a550-404a-8b1d-b3ceea662f14 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:46.037324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-528388fa-a550-404a-8b1d-b3ceea662f14 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:46.050791 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-528388fa-a550-404a-8b1d-b3ceea662f14 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1363 microversion: 2.1 time: 0.151663 Jun 22 12:02:46.051417 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 539/1126] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:45 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:46.376257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-74657539-64c7-49de-a7dc-df7fa215efdb req-7d3240e3-3561-4add-925e-25c7050b89b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d5f19a-cb48-42bb-a04d-07d266334096", "name": "network-vif-plugged", "status": "completed", "tag": "5ca10698-a742-41b2-9164-7aa7a8bd0795"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:46.384261 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-74657539-64c7-49de-a7dc-df7fa215efdb req-7d3240e3-3561-4add-925e-25c7050b89b2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:46.384702 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-74657539-64c7-49de-a7dc-df7fa215efdb req-7d3240e3-3561-4add-925e-25c7050b89b2 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:46.395855 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-74657539-64c7-49de-a7dc-df7fa215efdb req-7d3240e3-3561-4add-925e-25c7050b89b2 service nova] Creating event network-vif-plugged:5ca10698-a742-41b2-9164-7aa7a8bd0795 for instance c3d5f19a-cb48-42bb-a04d-07d266334096 on hv-cinder-83697 Jun 22 12:02:46.400978 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-74657539-64c7-49de-a7dc-df7fa215efdb req-7d3240e3-3561-4add-925e-25c7050b89b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088950 Jun 22 12:02:46.401550 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 588/1127] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:47.068151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e2677fc4-00b9-42a0-b9d7-f0a315654259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:47.068755 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e2677fc4-00b9-42a0-b9d7-f0a315654259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:47.075232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2677fc4-00b9-42a0-b9d7-f0a315654259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:47.075705 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2677fc4-00b9-42a0-b9d7-f0a315654259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:47.076449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2677fc4-00b9-42a0-b9d7-f0a315654259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:47.076876 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e2677fc4-00b9-42a0-b9d7-f0a315654259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:47.207754 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e2677fc4-00b9-42a0-b9d7-f0a315654259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:47.215205 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e2677fc4-00b9-42a0-b9d7-f0a315654259 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1363 microversion: 2.1 time: 0.150898 Jun 22 12:02:47.215779 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 540/1128] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:47 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:48.231370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:48.232272 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=6 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:48.237073 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-92cf1b79-c388-45fa-bd6b-bfa23f51e459 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:48.237767 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-92cf1b79-c388-45fa-bd6b-bfa23f51e459 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:48.244899 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-92cf1b79-c388-45fa-bd6b-bfa23f51e459 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:48.245338 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-92cf1b79-c388-45fa-bd6b-bfa23f51e459 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:48.246083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-92cf1b79-c388-45fa-bd6b-bfa23f51e459 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:48.246511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-92cf1b79-c388-45fa-bd6b-bfa23f51e459 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:48.374138 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-92cf1b79-c388-45fa-bd6b-bfa23f51e459 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:48.381985 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-92cf1b79-c388-45fa-bd6b-bfa23f51e459 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1552 microversion: 2.1 time: 0.152025 Jun 22 12:02:48.382540 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 589/1129] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:48 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:02:48.398323 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-589ca935-0f1e-4c6c-bd01-b7d66ea281d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:48.398823 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-589ca935-0f1e-4c6c-bd01-b7d66ea281d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:48.400757 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=6 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:48.406682 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589ca935-0f1e-4c6c-bd01-b7d66ea281d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:48.407125 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589ca935-0f1e-4c6c-bd01-b7d66ea281d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:48.407918 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589ca935-0f1e-4c6c-bd01-b7d66ea281d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:48.408354 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-589ca935-0f1e-4c6c-bd01-b7d66ea281d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:48.486337 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-589ca935-0f1e-4c6c-bd01-b7d66ea281d0 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091688 Jun 22 12:02:48.487433 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 541/1130] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 12:02:48 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:49.647497 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-aaa4df75-f725-4eb4-953c-8fe4df902312 req-5d139757-9cbb-452e-ae95-b150c67aa70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d5f19a-cb48-42bb-a04d-07d266334096", "tag": "5ca10698-a742-41b2-9164-7aa7a8bd0795"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:49.656047 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-aaa4df75-f725-4eb4-953c-8fe4df902312 req-5d139757-9cbb-452e-ae95-b150c67aa70a service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:49.656487 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-aaa4df75-f725-4eb4-953c-8fe4df902312 req-5d139757-9cbb-452e-ae95-b150c67aa70a service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:49.667175 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-aaa4df75-f725-4eb4-953c-8fe4df902312 req-5d139757-9cbb-452e-ae95-b150c67aa70a service nova] Creating event network-changed:5ca10698-a742-41b2-9164-7aa7a8bd0795 for instance c3d5f19a-cb48-42bb-a04d-07d266334096 on hv-cinder-83697 Jun 22 12:02:49.671977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-aaa4df75-f725-4eb4-953c-8fe4df902312 req-5d139757-9cbb-452e-ae95-b150c67aa70a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028401 Jun 22 12:02:49.672559 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 590/1131] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:02:59.045290 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:59.046983 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:59.050801 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-019bc7a0-ad23-4a4d-8343-91ce28120815 req-48311798-2de1-415d-b64c-d2346fb10948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5", "tag": "9d063124-fca9-4ccc-a48c-caf8bf3ca42b"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:02:59.051266 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-67ee6550-47c1-4dce-9e24-ede1f96466ab tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:59.052180 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-67ee6550-47c1-4dce-9e24-ede1f96466ab tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:59.056007 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:59.060447 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67ee6550-47c1-4dce-9e24-ede1f96466ab tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:59.060780 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-019bc7a0-ad23-4a4d-8343-91ce28120815 req-48311798-2de1-415d-b64c-d2346fb10948 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:59.060901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67ee6550-47c1-4dce-9e24-ede1f96466ab tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:59.061448 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-019bc7a0-ad23-4a4d-8343-91ce28120815 req-48311798-2de1-415d-b64c-d2346fb10948 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:59.062789 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67ee6550-47c1-4dce-9e24-ede1f96466ab tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:59.063225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-67ee6550-47c1-4dce-9e24-ede1f96466ab tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:59.066732 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:02:59.076319 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-019bc7a0-ad23-4a4d-8343-91ce28120815 req-48311798-2de1-415d-b64c-d2346fb10948 service nova] Creating event network-changed:9d063124-fca9-4ccc-a48c-caf8bf3ca42b for instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 on hv-cinder-83697 Jun 22 12:02:59.081952 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-019bc7a0-ad23-4a4d-8343-91ce28120815 req-48311798-2de1-415d-b64c-d2346fb10948 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036198 Jun 22 12:02:59.082885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 591/1132] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 12:02:59.090454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-67ee6550-47c1-4dce-9e24-ede1f96466ab tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 12:02:59.179069 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-67ee6550-47c1-4dce-9e24-ede1f96466ab tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "DELETE /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 204 len: 0 microversion: 2.1 time: 0.134918 Jun 22 12:02:59.180297 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 542/1133] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:02:59 2022] DELETE /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 12:02:59.191736 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-40679275-8db6-45a5-bbf2-ad9e1138a771 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:02:59.192466 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-40679275-8db6-45a5-bbf2-ad9e1138a771 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:02:59.200919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-40679275-8db6-45a5-bbf2-ad9e1138a771 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:59.201362 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-40679275-8db6-45a5-bbf2-ad9e1138a771 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:59.202126 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-40679275-8db6-45a5-bbf2-ad9e1138a771 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:02:59.202593 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-40679275-8db6-45a5-bbf2-ad9e1138a771 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:02:59.346212 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-40679275-8db6-45a5-bbf2-ad9e1138a771 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:02:59.353757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-40679275-8db6-45a5-bbf2-ad9e1138a771 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1575 microversion: 2.1 time: 0.169084 Jun 22 12:02:59.354556 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 592/1134] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:02:59 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:03:00.371749 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f0aa510d-47dd-4c3b-9e0e-363d64afc08c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:00.372351 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-f0aa510d-47dd-4c3b-9e0e-363d64afc08c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:00.379237 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f0aa510d-47dd-4c3b-9e0e-363d64afc08c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:00.379711 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f0aa510d-47dd-4c3b-9e0e-363d64afc08c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:00.380466 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f0aa510d-47dd-4c3b-9e0e-363d64afc08c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:00.380893 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-f0aa510d-47dd-4c3b-9e0e-363d64afc08c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:00.574298 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-f0aa510d-47dd-4c3b-9e0e-363d64afc08c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:03:00.581692 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f0aa510d-47dd-4c3b-9e0e-363d64afc08c tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1575 microversion: 2.1 time: 0.214239 Jun 22 12:03:00.582253 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 543/1135] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:03:00 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:03:01.598025 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-f854a4ad-3c8e-459c-bb44-8f9c92dd7519 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:01.598646 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-f854a4ad-3c8e-459c-bb44-8f9c92dd7519 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:01.604977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f854a4ad-3c8e-459c-bb44-8f9c92dd7519 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:01.605423 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f854a4ad-3c8e-459c-bb44-8f9c92dd7519 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:01.606171 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f854a4ad-3c8e-459c-bb44-8f9c92dd7519 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:01.606598 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-f854a4ad-3c8e-459c-bb44-8f9c92dd7519 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:01.678982 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-f854a4ad-3c8e-459c-bb44-8f9c92dd7519 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:03:01.686523 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-f854a4ad-3c8e-459c-bb44-8f9c92dd7519 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 200 len: 1390 microversion: 2.1 time: 0.092214 Jun 22 12:03:01.687882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 593/1136] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:03:01 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:03:01.703831 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-ba6de194-6fbf-4621-98dd-8824321ea258 req-c14f473b-79e9-432e-9b09-4fa2602a28aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5", "name": "network-vif-deleted", "tag": "9d063124-fca9-4ccc-a48c-caf8bf3ca42b"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:03:01.712713 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-ba6de194-6fbf-4621-98dd-8824321ea258 req-c14f473b-79e9-432e-9b09-4fa2602a28aa service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:01.713146 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-ba6de194-6fbf-4621-98dd-8824321ea258 req-c14f473b-79e9-432e-9b09-4fa2602a28aa service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:01.724001 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-ba6de194-6fbf-4621-98dd-8824321ea258 req-c14f473b-79e9-432e-9b09-4fa2602a28aa service nova] Creating event network-vif-deleted:9d063124-fca9-4ccc-a48c-caf8bf3ca42b for instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 on hv-cinder-83697 Jun 22 12:03:01.728885 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-ba6de194-6fbf-4621-98dd-8824321ea258 req-c14f473b-79e9-432e-9b09-4fa2602a28aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029186 Jun 22 12:03:01.729471 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 544/1137] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:03:02.704706 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:02.705251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:02.711775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:02.712225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:02.712986 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:02.713421 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:02.728401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] HTTP exception thrown: Instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 could not be found. Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Request method failure captured: Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 HTTP/1.1 Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswLMpZYhFMcV2Ro0csyO02NMbyGcafr4oiG36oiZfvorEKCvE5F7E9NPFEALHXA4LFF-5E89-EC2J9B8XmnDilScuSD9zyIxfjytZniTJNKqersR1wbQGJXkMtGR5c0qFtahP5zfDccmh_OvjzPi0E8LjJECmDIobn7OG-Hiv-dFaAI Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:03:02.730006 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_edbd324693e24bcdbf41c207d29d7e2e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-TestVolumeBootPattern-2089758583-project Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 239de565f79f474bb21699fd9adc96c4 Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-TestVolumeBootPattern-2089758583-project Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 could not be found. Jun 22 12:03:02.731704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5'} Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 could not be found. Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:03:02.732687 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 could not be found. Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 could not be found. Jun 22 12:03:02.734833 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:02.736347 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Returning 404 to user: Instance 857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:03:02.736347 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-14ee255e-4c77-44c1-b04f-89b4aa72f53d tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5" status: 404 len: 111 microversion: 2.1 time: 0.030637 Jun 22 12:03:02.736347 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 594/1138] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:03:02 2022] GET /compute/v2.1/servers/857605f9-0aa0-46a0-9a5b-8da8e3a7b1a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:03:05.751025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-266d7976-6d21-4e5e-b0d7-b1a95a887161 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:05.751677 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-266d7976-6d21-4e5e-b0d7-b1a95a887161 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:05.752227 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-9e9d1b8a-3b85-4841-b21e-0fbf29ba1076 req-a4359241-71d9-4881-820d-e71b37569747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b514f999-4c83-4dbd-a556-1037c269dcf9", "tag": "015aa5d0-cc6d-4302-9e81-85c44da33007"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:03:05.758105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-266d7976-6d21-4e5e-b0d7-b1a95a887161 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:05.758548 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-266d7976-6d21-4e5e-b0d7-b1a95a887161 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:05.759308 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-266d7976-6d21-4e5e-b0d7-b1a95a887161 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:05.759769 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-266d7976-6d21-4e5e-b0d7-b1a95a887161 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:05.761001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-9e9d1b8a-3b85-4841-b21e-0fbf29ba1076 req-a4359241-71d9-4881-820d-e71b37569747 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:05.761505 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-9e9d1b8a-3b85-4841-b21e-0fbf29ba1076 req-a4359241-71d9-4881-820d-e71b37569747 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:05.774667 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-9e9d1b8a-3b85-4841-b21e-0fbf29ba1076 req-a4359241-71d9-4881-820d-e71b37569747 service nova] Creating event network-changed:015aa5d0-cc6d-4302-9e81-85c44da33007 for instance b514f999-4c83-4dbd-a556-1037c269dcf9 on hv-cinder-83697 Jun 22 12:03:05.780108 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-9e9d1b8a-3b85-4841-b21e-0fbf29ba1076 req-a4359241-71d9-4881-820d-e71b37569747 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031783 Jun 22 12:03:05.780770 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 595/1139] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:03:05.804781 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-266d7976-6d21-4e5e-b0d7-b1a95a887161 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 12:03:05.888080 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-266d7976-6d21-4e5e-b0d7-b1a95a887161 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 204 len: 0 microversion: 2.1 time: 0.141679 Jun 22 12:03:05.888772 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 545/1140] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:03:05 2022] DELETE /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 12:03:05.898248 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1f4b18b2-3019-46e0-b773-ce62e6c8c295 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:05.898938 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1f4b18b2-3019-46e0-b773-ce62e6c8c295 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:05.905160 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f4b18b2-3019-46e0-b773-ce62e6c8c295 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:05.905602 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f4b18b2-3019-46e0-b773-ce62e6c8c295 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:05.906357 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f4b18b2-3019-46e0-b773-ce62e6c8c295 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:05.906972 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1f4b18b2-3019-46e0-b773-ce62e6c8c295 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:06.042706 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-1f4b18b2-3019-46e0-b773-ce62e6c8c295 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:03:06.050572 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1f4b18b2-3019-46e0-b773-ce62e6c8c295 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1578 microversion: 2.1 time: 0.156733 Jun 22 12:03:06.051358 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 596/1141] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:03:05 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:03:07.068969 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2dbf84d4-8ee4-47ff-82fd-93e4e904ec3a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:07.069665 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2dbf84d4-8ee4-47ff-82fd-93e4e904ec3a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:07.076310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2dbf84d4-8ee4-47ff-82fd-93e4e904ec3a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:07.076759 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2dbf84d4-8ee4-47ff-82fd-93e4e904ec3a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:07.077530 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2dbf84d4-8ee4-47ff-82fd-93e4e904ec3a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:07.077957 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2dbf84d4-8ee4-47ff-82fd-93e4e904ec3a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:07.210248 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2dbf84d4-8ee4-47ff-82fd-93e4e904ec3a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:03:07.217746 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2dbf84d4-8ee4-47ff-82fd-93e4e904ec3a tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1578 microversion: 2.1 time: 0.152980 Jun 22 12:03:07.218312 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 546/1142] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:03:07 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:03:08.099528 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-6de11f41-e714-4acb-be56-98fe3f82fe1c req-e5e3e614-08f5-49a0-9036-a120e02e0b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b514f999-4c83-4dbd-a556-1037c269dcf9", "name": "network-vif-deleted", "tag": "015aa5d0-cc6d-4302-9e81-85c44da33007"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:03:08.108104 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-6de11f41-e714-4acb-be56-98fe3f82fe1c req-e5e3e614-08f5-49a0-9036-a120e02e0b2c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:08.108542 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-6de11f41-e714-4acb-be56-98fe3f82fe1c req-e5e3e614-08f5-49a0-9036-a120e02e0b2c service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:08.119400 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-6de11f41-e714-4acb-be56-98fe3f82fe1c req-e5e3e614-08f5-49a0-9036-a120e02e0b2c service nova] Creating event network-vif-deleted:015aa5d0-cc6d-4302-9e81-85c44da33007 for instance b514f999-4c83-4dbd-a556-1037c269dcf9 on hv-cinder-83697 Jun 22 12:03:08.124264 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-6de11f41-e714-4acb-be56-98fe3f82fe1c req-e5e3e614-08f5-49a0-9036-a120e02e0b2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029015 Jun 22 12:03:08.124850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 597/1143] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:03:08.234164 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-d05691c9-276d-4128-9c9d-3dc004ce5dbf tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:08.234768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-d05691c9-276d-4128-9c9d-3dc004ce5dbf tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:08.241081 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d05691c9-276d-4128-9c9d-3dc004ce5dbf tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:08.241524 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d05691c9-276d-4128-9c9d-3dc004ce5dbf tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:08.242274 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d05691c9-276d-4128-9c9d-3dc004ce5dbf tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:08.242703 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-d05691c9-276d-4128-9c9d-3dc004ce5dbf tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:08.305451 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-d05691c9-276d-4128-9c9d-3dc004ce5dbf tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239de565f79f474bb21699fd9adc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbd324693e24bcdbf41c207d29d7e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:03:08.312832 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-d05691c9-276d-4128-9c9d-3dc004ce5dbf tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 200 len: 1225 microversion: 2.1 time: 0.082539 Jun 22 12:03:08.313898 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 547/1144] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:03:08 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:03:09.333078 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:09.333769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: b514f999-4c83-4dbd-a556-1037c269dcf9] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:09.339924 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:09.340387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:09.341161 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:09.341586 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:09.354878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] HTTP exception thrown: Instance b514f999-4c83-4dbd-a556-1037c269dcf9 could not be found. Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Request method failure captured: Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 HTTP/1.1 Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswLMpZYhFMcV2Ro0csyO02NMbyGcafr4oiG36oiZfvorEKCvE5F7E9NPFEALHXA4LFF-5E89-EC2J9B8XmnDilScuSD9zyIxfjytZniTJNKqersR1wbQGJXkMtGR5c0qFtahP5zfDccmh_OvjzPi0E8LjJECmDIobn7OG-Hiv-dFaAI Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:03:09.356546 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_edbd324693e24bcdbf41c207d29d7e2e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-TestVolumeBootPattern-2089758583-project Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 239de565f79f474bb21699fd9adc96c4 Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-TestVolumeBootPattern-2089758583-project Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance b514f999-4c83-4dbd-a556-1037c269dcf9 could not be found. Jun 22 12:03:09.358064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'b514f999-4c83-4dbd-a556-1037c269dcf9'} Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b514f999-4c83-4dbd-a556-1037c269dcf9 could not be found. Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:03:09.358885 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b514f999-4c83-4dbd-a556-1037c269dcf9 could not be found. Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b514f999-4c83-4dbd-a556-1037c269dcf9 could not be found. Jun 22 12:03:09.361050 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.362436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Returning 404 to user: Instance b514f999-4c83-4dbd-a556-1037c269dcf9 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:03:09.362436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-35239746-6bd1-43d2-bf06-40bfeafb2fc2 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9" status: 404 len: 111 microversion: 2.1 time: 0.031100 Jun 22 12:03:09.362436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 598/1145] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:03:09 2022] GET /compute/v2.1/servers/b514f999-4c83-4dbd-a556-1037c269dcf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:03:09.787846 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:09.788374 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:09.794836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:09.795278 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:09.796070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:09.796504 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:09.809944 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] HTTP exception thrown: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Request method failure captured: Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 HTTP/1.1 Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswLMpZYhFMcV2Ro0csyO02NMbyGcafr4oiG36oiZfvorEKCvE5F7E9NPFEALHXA4LFF-5E89-EC2J9B8XmnDilScuSD9zyIxfjytZniTJNKqersR1wbQGJXkMtGR5c0qFtahP5zfDccmh_OvjzPi0E8LjJECmDIobn7OG-Hiv-dFaAI Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:03:09.811676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_edbd324693e24bcdbf41c207d29d7e2e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-TestVolumeBootPattern-2089758583-project Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 239de565f79f474bb21699fd9adc96c4 Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-TestVolumeBootPattern-2089758583-project Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.813333 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '8cf7624b-dc26-4c19-91c9-0a2267b82315'} Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:03:09.814958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.816275 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.817662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Returning 404 to user: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:03:09.817662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a0a9df93-770d-4fbb-927a-ca6891d06054 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 404 len: 111 microversion: 2.1 time: 0.029067 Jun 22 12:03:09.817662 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 548/1146] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:03:09 2022] DELETE /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:03:09.822267 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:09.822878 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] [instance: 8cf7624b-dc26-4c19-91c9-0a2267b82315] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:03:09.828890 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:09.829335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:09.830255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:03:09.831175 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:03:09.844074 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] HTTP exception thrown: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Request method failure captured: Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 HTTP/1.1 Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswLMpZYhFMcV2Ro0csyO02NMbyGcafr4oiG36oiZfvorEKCvE5F7E9NPFEALHXA4LFF-5E89-EC2J9B8XmnDilScuSD9zyIxfjytZniTJNKqersR1wbQGJXkMtGR5c0qFtahP5zfDccmh_OvjzPi0E8LjJECmDIobn7OG-Hiv-dFaAI Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:03:09.845605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_edbd324693e24bcdbf41c207d29d7e2e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/edbd324693e24bcdbf41c207d29d7e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: edbd324693e24bcdbf41c207d29d7e2e Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-TestVolumeBootPattern-2089758583 Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-TestVolumeBootPattern-2089758583-project Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 239de565f79f474bb21699fd9adc96c4 Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-TestVolumeBootPattern-2089758583-project Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.847213 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '8cf7624b-dc26-4c19-91c9-0a2267b82315'} Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:03:09.848332 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. Jun 22 12:03:09.849865 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:03:09.851393 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Returning 404 to user: Instance 8cf7624b-dc26-4c19-91c9-0a2267b82315 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:03:09.851393 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8b05dc79-55ae-4da4-b786-d1694ae79a40 tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315" status: 404 len: 111 microversion: 2.1 time: 0.028510 Jun 22 12:03:09.851393 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 599/1147] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:03:09 2022] GET /compute/v2.1/servers/8cf7624b-dc26-4c19-91c9-0a2267b82315 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:03:11.125768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-39f19729-6883-4a88-8164-d0cbeac5371f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] Calling method '.version_select at 0x7f3ea8367a60>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:03:11.144343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-39f19729-6883-4a88-8164-d0cbeac5371f tempest-TestVolumeBootPattern-2089758583 tempest-TestVolumeBootPattern-2089758583-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-979420716" status: 202 len: 0 microversion: 2.1 time: 0.022386 Jun 22 12:03:11.145170 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 549/1148] 10.222.0.36 () {58 vars in 1259 bytes} [Wed Jun 22 12:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-979420716 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:03:47.143426 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:03:47.144796 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 12:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:04:04.532779 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=17 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:04:04.533499 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=29 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:04:04.691117 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b647d9d5-f803-4bb7-ad87-5dcb5280b871 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:04.691627 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-b647d9d5-f803-4bb7-ad87-5dcb5280b871 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:04.697521 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b647d9d5-f803-4bb7-ad87-5dcb5280b871 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:04.697958 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b647d9d5-f803-4bb7-ad87-5dcb5280b871 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:04.698703 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b647d9d5-f803-4bb7-ad87-5dcb5280b871 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:04.699131 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-b647d9d5-f803-4bb7-ad87-5dcb5280b871 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:04.721288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b647d9d5-f803-4bb7-ad87-5dcb5280b871 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/ips" status: 200 len: 148 microversion: 2.1 time: 0.193409 Jun 22 12:04:04.722299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 600/1149] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 12:04:04 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/ips => generated 148 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:04:06.023836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:04:06.024592 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:04:06.029658 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3c16c328-4c38-48e6-b76c-1d4c2811d31a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7737042-a22a-40ab-8dcc-7b3bf06d24ba"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:04:06.031930 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3c16c328-4c38-48e6-b76c-1d4c2811d31a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:06.040896 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c16c328-4c38-48e6-b76c-1d4c2811d31a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:06.041395 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c16c328-4c38-48e6-b76c-1d4c2811d31a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:06.042142 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c16c328-4c38-48e6-b76c-1d4c2811d31a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:06.042565 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3c16c328-4c38-48e6-b76c-1d4c2811d31a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:06.290453 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3c16c328-4c38-48e6-b76c-1d4c2811d31a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268524 Jun 22 12:04:06.291151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 550/1150] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 12:04:06 2022] POST /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:04:13.769218 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7737042-a22a-40ab-8dcc-7b3bf06d24ba"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:04:13.770335 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:13.776594 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:13.777038 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:13.777788 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:13.778221 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:13.857882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Invalid volume: volume b7737042-a22a-40ab-8dcc-7b3bf06d24ba is already attached to instances: c3d5f19a-cb48-42bb-a04d-07d266334096 Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: POST /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments HTTP/1.1 Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 74 Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:04:13.859530 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {"volumeAttachment": {"volumeId": "b7737042-a22a-40ab-8dcc-7b3bf06d24ba"}} Jun 22 12:04:13.861301 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Invalid volume: volume b7737042-a22a-40ab-8dcc-7b3bf06d24ba is already attached to instances: c3d5f19a-cb48-42bb-a04d-07d266334096 Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'server_id': 'c3d5f19a-cb48-42bb-a04d-07d266334096', 'body': {'volumeAttachment': {'volumeId': 'b7737042-a22a-40ab-8dcc-7b3bf06d24ba'}}} Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b7737042-a22a-40ab-8dcc-7b3bf06d24ba is already attached to instances: c3d5f19a-cb48-42bb-a04d-07d266334096 Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:04:13.862367 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b7737042-a22a-40ab-8dcc-7b3bf06d24ba is already attached to instances: c3d5f19a-cb48-42bb-a04d-07d266334096 Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:04:13.863980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:04:13.865676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:04:13.865676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:04:13.865676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:04:13.865676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b7737042-a22a-40ab-8dcc-7b3bf06d24ba is already attached to instances: c3d5f19a-cb48-42bb-a04d-07d266334096 Jun 22 12:04:13.865676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:04:13.865676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 400 to user: Invalid volume: volume b7737042-a22a-40ab-8dcc-7b3bf06d24ba is already attached to instances: c3d5f19a-cb48-42bb-a04d-07d266334096 {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:04:13.865676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-80ff946f-f4e9-4636-bb8f-d66e859d7a93 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095931 Jun 22 12:04:13.865676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 601/1151] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 12:04:13 2022] POST /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 12:04:13.922991 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0720909d-b1d6-4540-9975-2509a793132e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:13.923594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-0720909d-b1d6-4540-9975-2509a793132e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:13.929765 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0720909d-b1d6-4540-9975-2509a793132e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:13.930201 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0720909d-b1d6-4540-9975-2509a793132e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:13.930948 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0720909d-b1d6-4540-9975-2509a793132e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:13.931395 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-0720909d-b1d6-4540-9975-2509a793132e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:14.016567 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-0720909d-b1d6-4540-9975-2509a793132e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lazy-loading 'services' on Instance uuid c3d5f19a-cb48-42bb-a04d-07d266334096 {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 12:04:14.088297 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0720909d-b1d6-4540-9975-2509a793132e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments/b7737042-a22a-40ab-8dcc-7b3bf06d24ba" status: 202 len: 0 microversion: 2.1 time: 0.169704 Jun 22 12:04:14.088881 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 551/1152] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 12:04:13 2022] DELETE /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments/b7737042-a22a-40ab-8dcc-7b3bf06d24ba => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:04:14.097635 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-29737e1d-274e-4e9e-a83a-06550077fd3e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:14.098594 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-29737e1d-274e-4e9e-a83a-06550077fd3e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:14.105401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-29737e1d-274e-4e9e-a83a-06550077fd3e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:14.105850 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-29737e1d-274e-4e9e-a83a-06550077fd3e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:14.106633 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-29737e1d-274e-4e9e-a83a-06550077fd3e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:14.107064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-29737e1d-274e-4e9e-a83a-06550077fd3e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:14.135591 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-29737e1d-274e-4e9e-a83a-06550077fd3e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Jun 22 12:04:14.136139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 602/1153] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 12:04:14 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:04:15.148353 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-658910a2-86d0-4fac-b3f6-4ffa7346f6a3 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:15.149425 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-658910a2-86d0-4fac-b3f6-4ffa7346f6a3 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:15.155630 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-658910a2-86d0-4fac-b3f6-4ffa7346f6a3 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:15.156067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-658910a2-86d0-4fac-b3f6-4ffa7346f6a3 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:15.156800 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-658910a2-86d0-4fac-b3f6-4ffa7346f6a3 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:15.157221 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-658910a2-86d0-4fac-b3f6-4ffa7346f6a3 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:15.185490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-658910a2-86d0-4fac-b3f6-4ffa7346f6a3 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042180 Jun 22 12:04:15.186020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 552/1154] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 12:04:15 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 12:04:15.247372 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ad54fb98-c218-433c-bed6-134ef4a3f3b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:15.247863 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ad54fb98-c218-433c-bed6-134ef4a3f3b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:15.254382 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ad54fb98-c218-433c-bed6-134ef4a3f3b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:15.254823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ad54fb98-c218-433c-bed6-134ef4a3f3b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:15.255633 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ad54fb98-c218-433c-bed6-134ef4a3f3b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:15.256045 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ad54fb98-c218-433c-bed6-134ef4a3f3b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:15.281717 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ad54fb98-c218-433c-bed6-134ef4a3f3b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 12:04:15.355528 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ad54fb98-c218-433c-bed6-134ef4a3f3b4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 204 len: 0 microversion: 2.1 time: 0.111440 Jun 22 12:04:15.356206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 603/1155] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:04:15 2022] DELETE /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 12:04:15.365294 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-c3e954a9-2f51-4867-9032-907cc41b9b83 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:15.365882 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-c3e954a9-2f51-4867-9032-907cc41b9b83 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:15.371922 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c3e954a9-2f51-4867-9032-907cc41b9b83 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:15.372363 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c3e954a9-2f51-4867-9032-907cc41b9b83 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:15.373105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c3e954a9-2f51-4867-9032-907cc41b9b83 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:15.373532 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-c3e954a9-2f51-4867-9032-907cc41b9b83 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:15.498970 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-c3e954a9-2f51-4867-9032-907cc41b9b83 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:15.506531 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-c3e954a9-2f51-4867-9032-907cc41b9b83 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1676 microversion: 2.1 time: 0.146096 Jun 22 12:04:15.507087 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 553/1156] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:15 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:16.525359 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4d7a5bb4-7b3e-4e57-bc7d-830f1b74b087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:16.526056 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4d7a5bb4-7b3e-4e57-bc7d-830f1b74b087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:16.532453 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4d7a5bb4-7b3e-4e57-bc7d-830f1b74b087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:16.532898 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4d7a5bb4-7b3e-4e57-bc7d-830f1b74b087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:16.533649 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4d7a5bb4-7b3e-4e57-bc7d-830f1b74b087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:16.534079 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4d7a5bb4-7b3e-4e57-bc7d-830f1b74b087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:16.921250 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4d7a5bb4-7b3e-4e57-bc7d-830f1b74b087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:16.929251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4d7a5bb4-7b3e-4e57-bc7d-830f1b74b087 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1676 microversion: 2.1 time: 0.408426 Jun 22 12:04:16.930009 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 604/1157] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:16 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1676 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:17.948136 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b12af0ee-0498-4248-a176-7e86b305e812 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:17.948841 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b12af0ee-0498-4248-a176-7e86b305e812 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:17.955339 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b12af0ee-0498-4248-a176-7e86b305e812 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:17.955813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b12af0ee-0498-4248-a176-7e86b305e812 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:17.956562 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b12af0ee-0498-4248-a176-7e86b305e812 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:17.957608 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b12af0ee-0498-4248-a176-7e86b305e812 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:18.018144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b12af0ee-0498-4248-a176-7e86b305e812 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:18.026305 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b12af0ee-0498-4248-a176-7e86b305e812 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 200 len: 1610 microversion: 2.1 time: 0.083675 Jun 22 12:04:18.026860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 554/1158] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:17 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 1610 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 12:04:18.250496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-ba003b6e-66b8-419b-9ada-0bdbb7509570 req-74d99cbf-71a7-4063-afb5-cf34cc5d980f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d5f19a-cb48-42bb-a04d-07d266334096", "name": "network-vif-deleted", "tag": "5ca10698-a742-41b2-9164-7aa7a8bd0795"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:04:18.263886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-ba003b6e-66b8-419b-9ada-0bdbb7509570 req-74d99cbf-71a7-4063-afb5-cf34cc5d980f service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:18.264534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-ba003b6e-66b8-419b-9ada-0bdbb7509570 req-74d99cbf-71a7-4063-afb5-cf34cc5d980f service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:18.277518 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-ba003b6e-66b8-419b-9ada-0bdbb7509570 req-74d99cbf-71a7-4063-afb5-cf34cc5d980f service nova] Creating event network-vif-deleted:5ca10698-a742-41b2-9164-7aa7a8bd0795 for instance c3d5f19a-cb48-42bb-a04d-07d266334096 on hv-cinder-83697 Jun 22 12:04:18.284093 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-ba003b6e-66b8-419b-9ada-0bdbb7509570 req-74d99cbf-71a7-4063-afb5-cf34cc5d980f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098065 Jun 22 12:04:18.285366 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 605/1159] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:04:19.043563 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:19.044173 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:19.051070 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:19.051544 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:19.052303 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:19.052739 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:19.065817 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 HTTP/1.1 Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:04:19.067502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:04:19.069255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'c3d5f19a-cb48-42bb-a04d-07d266334096'} Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:04:19.070209 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:04:19.071792 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:04:19.073151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:04:19.073151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-7f82ca1b-3251-43e9-bbc8-03c227f2f6bc tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 404 len: 111 microversion: 2.1 time: 0.029236 Jun 22 12:04:19.073151 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 555/1160] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:19 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:04:19.078402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cfc2122e-caa3-4277-bf43-79b360a01518 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '.version_select at 0x7f3ea80ed940>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:19.097095 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cfc2122e-caa3-4277-bf43-79b360a01518 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-590182048" status: 202 len: 0 microversion: 2.1 time: 0.022701 Jun 22 12:04:19.098169 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 606/1161] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Jun 22 12:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-590182048 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:04:19.700826 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-98790027-ca35-402e-b599-8db254115c05 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: .version_select at 0x7f3ea8375790>, body: {"keypair": {"name": "tempest-keypair-1420369224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICirzrIEdZlqo3iVkOcg+DttnRxU0Me9GPmjHVgSMcQpK5otBxRNm7QLZDunhBrEhvtTNHQeZmfE9e6zuz9LNaCrRxHA6u9YRjse8Qje8Hw8tgfnmcsovoIToKzi0H0fQ=="}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:04:19.715106 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-98790027-ca35-402e-b599-8db254115c05 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for project 897ec8bf954c41648da9cac00bc44749. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:04:19.718832 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-98790027-ca35-402e-b599-8db254115c05 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for user f2d34a97831f4a7c885ebe64aecb3669 and project 897ec8bf954c41648da9cac00bc44749. Resources: {'key_pairs'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:04:19.740721 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-98790027-ca35-402e-b599-8db254115c05 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043710 Jun 22 12:04:19.741410 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 556/1162] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 12:04:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:04:21.161758 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-896374783", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c591d2a-1888-4ad8-90c9-cd1f4c969134"}], "security_groups": [{"name": "tempest-securitygroup--481801900"}], "key_name": "tempest-keypair-1420369224", "user_data": "}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:04:21.263934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] validate_networks() for [('0c591d2a-1888-4ad8-90c9-cd1f4c969134', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 12:04:21.717977 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 12:04:21.718399 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 12:04:21.718897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 12:04:21.719306 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 12:04:21.719744 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 12:04:21.728980 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:21.729422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:21.730210 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:21.730642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:21.747419 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for project 897ec8bf954c41648da9cac00bc44749. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:04:21.751326 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Getting quotas for user f2d34a97831f4a7c885ebe64aecb3669 and project 897ec8bf954c41648da9cac00bc44749. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:04:21.762136 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 12:04:21.764456 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 12:04:21.811774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-09c8d1f9-5a21-4851-91d8-0d0b2ee3db53 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.654661 Jun 22 12:04:21.812412 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 607/1163] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 12:04:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 12:04:21.822250 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-9affe103-9cc6-419b-b460-46f642fb8dd2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:21.822859 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-9affe103-9cc6-419b-b460-46f642fb8dd2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:21.878844 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-9affe103-9cc6-419b-b460-46f642fb8dd2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:21.885576 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-9affe103-9cc6-419b-b460-46f642fb8dd2 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1241 microversion: 2.1 time: 0.067137 Jun 22 12:04:21.886149 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 557/1164] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:21 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:22.902718 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-155a4503-480a-4673-bdfa-6251d441fb5f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:22.903425 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-155a4503-480a-4673-bdfa-6251d441fb5f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:22.910152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-155a4503-480a-4673-bdfa-6251d441fb5f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:22.910681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-155a4503-480a-4673-bdfa-6251d441fb5f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:22.911548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-155a4503-480a-4673-bdfa-6251d441fb5f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:22.912074 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-155a4503-480a-4673-bdfa-6251d441fb5f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:22.972464 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-155a4503-480a-4673-bdfa-6251d441fb5f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:22.979901 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-155a4503-480a-4673-bdfa-6251d441fb5f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1299 microversion: 2.1 time: 0.081722 Jun 22 12:04:22.980467 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 608/1165] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:22 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:23.999700 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b13ccb2e-b8a6-43dc-9777-2f38b9d3ba6e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:24.001348 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b13ccb2e-b8a6-43dc-9777-2f38b9d3ba6e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:24.007888 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13ccb2e-b8a6-43dc-9777-2f38b9d3ba6e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:24.008332 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13ccb2e-b8a6-43dc-9777-2f38b9d3ba6e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:24.009095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13ccb2e-b8a6-43dc-9777-2f38b9d3ba6e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:24.009723 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b13ccb2e-b8a6-43dc-9777-2f38b9d3ba6e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:24.158773 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-b13ccb2e-b8a6-43dc-9777-2f38b9d3ba6e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:24.161503 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-46b69efb-b7e1-4682-a07a-ad24ea7248d7 req-b8b490ce-83d0-41af-becf-41bf9f7c0382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc", "tag": "afac9a9e-a0ac-4883-bc25-183ab45d03e1"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:04:24.172454 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-46b69efb-b7e1-4682-a07a-ad24ea7248d7 req-b8b490ce-83d0-41af-becf-41bf9f7c0382 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:24.172889 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-46b69efb-b7e1-4682-a07a-ad24ea7248d7 req-b8b490ce-83d0-41af-becf-41bf9f7c0382 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:24.181759 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b13ccb2e-b8a6-43dc-9777-2f38b9d3ba6e tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1366 microversion: 2.1 time: 0.178436 Jun 22 12:04:24.183388 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 558/1166] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:23 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:24.185023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-46b69efb-b7e1-4682-a07a-ad24ea7248d7 req-b8b490ce-83d0-41af-becf-41bf9f7c0382 service nova] Creating event network-changed:afac9a9e-a0ac-4883-bc25-183ab45d03e1 for instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc on hv-cinder-83697 Jun 22 12:04:24.195468 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-46b69efb-b7e1-4682-a07a-ad24ea7248d7 req-b8b490ce-83d0-41af-becf-41bf9f7c0382 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038136 Jun 22 12:04:24.196104 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 609/1167] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 12:04:25.197987 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e8934eaa-bd1d-47ad-b2bb-419244c8a6ec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:25.198597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-e8934eaa-bd1d-47ad-b2bb-419244c8a6ec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:25.205081 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8934eaa-bd1d-47ad-b2bb-419244c8a6ec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:25.205526 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8934eaa-bd1d-47ad-b2bb-419244c8a6ec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:25.206276 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8934eaa-bd1d-47ad-b2bb-419244c8a6ec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:25.207272 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-e8934eaa-bd1d-47ad-b2bb-419244c8a6ec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:25.343836 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-e8934eaa-bd1d-47ad-b2bb-419244c8a6ec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:25.351639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e8934eaa-bd1d-47ad-b2bb-419244c8a6ec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1366 microversion: 2.1 time: 0.157521 Jun 22 12:04:25.352195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 559/1168] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:25 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:26.368097 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-19580eae-5286-441c-94d9-c739ab4ebf69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:26.368701 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-19580eae-5286-441c-94d9-c739ab4ebf69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:26.375302 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19580eae-5286-441c-94d9-c739ab4ebf69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:26.375769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19580eae-5286-441c-94d9-c739ab4ebf69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:26.376511 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19580eae-5286-441c-94d9-c739ab4ebf69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:26.376956 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-19580eae-5286-441c-94d9-c739ab4ebf69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:26.504384 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-19580eae-5286-441c-94d9-c739ab4ebf69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:26.511619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-19580eae-5286-441c-94d9-c739ab4ebf69 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1366 microversion: 2.1 time: 0.147820 Jun 22 12:04:26.512172 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 610/1169] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:26 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:27.529681 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-975a0d3a-b196-4756-a726-99be85d2b694 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:27.530225 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-975a0d3a-b196-4756-a726-99be85d2b694 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:27.537052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-975a0d3a-b196-4756-a726-99be85d2b694 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:27.537497 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-975a0d3a-b196-4756-a726-99be85d2b694 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:27.538246 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-975a0d3a-b196-4756-a726-99be85d2b694 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:27.538669 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-975a0d3a-b196-4756-a726-99be85d2b694 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:27.672516 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-975a0d3a-b196-4756-a726-99be85d2b694 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:27.680067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-975a0d3a-b196-4756-a726-99be85d2b694 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1366 microversion: 2.1 time: 0.154538 Jun 22 12:04:27.680624 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 560/1170] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:27 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:28.696805 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e16538a8-8d68-47c0-af52-515b79b89eec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:28.697404 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e16538a8-8d68-47c0-af52-515b79b89eec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:28.703810 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e16538a8-8d68-47c0-af52-515b79b89eec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:28.704257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e16538a8-8d68-47c0-af52-515b79b89eec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:28.705001 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e16538a8-8d68-47c0-af52-515b79b89eec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:28.705426 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e16538a8-8d68-47c0-af52-515b79b89eec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:28.842141 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e16538a8-8d68-47c0-af52-515b79b89eec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:28.850482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e16538a8-8d68-47c0-af52-515b79b89eec tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1366 microversion: 2.1 time: 0.157449 Jun 22 12:04:28.851061 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 611/1171] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:28 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:28.957754 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-2114ebed-11af-46cd-9a8a-38bdfc63a9ac req-5a450355-744f-46e9-8186-95c8b8761cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc", "name": "network-vif-plugged", "status": "completed", "tag": "afac9a9e-a0ac-4883-bc25-183ab45d03e1"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:04:28.967320 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-2114ebed-11af-46cd-9a8a-38bdfc63a9ac req-5a450355-744f-46e9-8186-95c8b8761cd8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:28.968508 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-2114ebed-11af-46cd-9a8a-38bdfc63a9ac req-5a450355-744f-46e9-8186-95c8b8761cd8 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:28.987025 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-2114ebed-11af-46cd-9a8a-38bdfc63a9ac req-5a450355-744f-46e9-8186-95c8b8761cd8 service nova] Creating event network-vif-plugged:afac9a9e-a0ac-4883-bc25-183ab45d03e1 for instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc on hv-cinder-83697 Jun 22 12:04:28.992124 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-2114ebed-11af-46cd-9a8a-38bdfc63a9ac req-5a450355-744f-46e9-8186-95c8b8761cd8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038650 Jun 22 12:04:28.992928 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 561/1172] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:04:29.868147 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e847a8e4-3422-43ac-bcdf-ce36bdb60480 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:29.868704 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e847a8e4-3422-43ac-bcdf-ce36bdb60480 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:29.875002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e847a8e4-3422-43ac-bcdf-ce36bdb60480 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:29.875468 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e847a8e4-3422-43ac-bcdf-ce36bdb60480 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:29.876211 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e847a8e4-3422-43ac-bcdf-ce36bdb60480 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:29.876637 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e847a8e4-3422-43ac-bcdf-ce36bdb60480 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:30.010435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e847a8e4-3422-43ac-bcdf-ce36bdb60480 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:30.017882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e847a8e4-3422-43ac-bcdf-ce36bdb60480 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1366 microversion: 2.1 time: 0.153623 Jun 22 12:04:30.018436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 612/1173] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:29 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:31.034714 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-508475f6-e430-46ec-91f3-3f744e08ba04 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:31.035419 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-508475f6-e430-46ec-91f3-3f744e08ba04 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:31.042157 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-508475f6-e430-46ec-91f3-3f744e08ba04 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:31.042581 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-508475f6-e430-46ec-91f3-3f744e08ba04 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:31.043324 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-508475f6-e430-46ec-91f3-3f744e08ba04 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:31.043770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-508475f6-e430-46ec-91f3-3f744e08ba04 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:31.169574 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-508475f6-e430-46ec-91f3-3f744e08ba04 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:04:31.177459 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-508475f6-e430-46ec-91f3-3f744e08ba04 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1555 microversion: 2.1 time: 0.146977 Jun 22 12:04:31.178012 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 562/1174] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:04:31 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:04:31.193994 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0c1fdfbb-0a02-4c0c-b114-e7dd66395a1f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:04:31.194482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0c1fdfbb-0a02-4c0c-b114-e7dd66395a1f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:04:31.200872 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c1fdfbb-0a02-4c0c-b114-e7dd66395a1f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:31.201257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c1fdfbb-0a02-4c0c-b114-e7dd66395a1f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:31.202002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c1fdfbb-0a02-4c0c-b114-e7dd66395a1f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:31.202428 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0c1fdfbb-0a02-4c0c-b114-e7dd66395a1f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:31.277707 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0c1fdfbb-0a02-4c0c-b114-e7dd66395a1f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088045 Jun 22 12:04:31.278371 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 613/1175] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 12:04:31 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:04:32.185463 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=6 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:04:32.245765 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-10a596c7-72fe-4946-8a10-86e2a92056dc req-59c178ea-f6e4-4623-910f-cceed6a7f37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc", "tag": "afac9a9e-a0ac-4883-bc25-183ab45d03e1"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:04:32.253827 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-10a596c7-72fe-4946-8a10-86e2a92056dc req-59c178ea-f6e4-4623-910f-cceed6a7f37d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:04:32.254262 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-10a596c7-72fe-4946-8a10-86e2a92056dc req-59c178ea-f6e4-4623-910f-cceed6a7f37d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:04:32.265263 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-10a596c7-72fe-4946-8a10-86e2a92056dc req-59c178ea-f6e4-4623-910f-cceed6a7f37d service nova] Creating event network-changed:afac9a9e-a0ac-4883-bc25-183ab45d03e1 for instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc on hv-cinder-83697 Jun 22 12:04:32.272329 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-10a596c7-72fe-4946-8a10-86e2a92056dc req-59c178ea-f6e4-4623-910f-cceed6a7f37d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090955 Jun 22 12:04:32.272981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 563/1176] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:05:47.121887 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:05:47.122653 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=6 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:05:47.124156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:05:47.124776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:05:47.129386 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-21adccab-2a76-4782-8446-3e6dcbdd7444 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:05:47.129877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-21adccab-2a76-4782-8446-3e6dcbdd7444 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:05:47.138714 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-21adccab-2a76-4782-8446-3e6dcbdd7444 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:47.139156 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-21adccab-2a76-4782-8446-3e6dcbdd7444 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:47.139940 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-21adccab-2a76-4782-8446-3e6dcbdd7444 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:47.140373 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-21adccab-2a76-4782-8446-3e6dcbdd7444 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:47.165253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-21adccab-2a76-4782-8446-3e6dcbdd7444 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/ips" status: 200 len: 149 microversion: 2.1 time: 0.044523 Jun 22 12:05:47.165809 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 614/1177] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 12:05:47 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:05:48.493843 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:05:48.494569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:05:48.499315 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-78191fb0-35cf-4e64-85a1-cb20b1d57f61 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7192b9ad-aaec-4d78-a5f1-5606584dc998"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:05:48.500461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-78191fb0-35cf-4e64-85a1-cb20b1d57f61 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:05:48.508511 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-78191fb0-35cf-4e64-85a1-cb20b1d57f61 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:48.508944 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-78191fb0-35cf-4e64-85a1-cb20b1d57f61 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:48.510187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-78191fb0-35cf-4e64-85a1-cb20b1d57f61 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:48.510610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-78191fb0-35cf-4e64-85a1-cb20b1d57f61 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:48.876690 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-78191fb0-35cf-4e64-85a1-cb20b1d57f61 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "POST /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384796 Jun 22 12:05:48.877283 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 564/1178] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 12:05:48 2022] POST /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:05:56.457490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d44d3416-1f2d-46f4-a494-14b2b43b027f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:05:56.458012 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d44d3416-1f2d-46f4-a494-14b2b43b027f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:05:56.464800 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d44d3416-1f2d-46f4-a494-14b2b43b027f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:56.465245 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d44d3416-1f2d-46f4-a494-14b2b43b027f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:56.466000 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d44d3416-1f2d-46f4-a494-14b2b43b027f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:56.466434 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d44d3416-1f2d-46f4-a494-14b2b43b027f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:56.595144 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-d44d3416-1f2d-46f4-a494-14b2b43b027f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lazy-loading 'services' on Instance uuid 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 12:05:56.667384 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d44d3416-1f2d-46f4-a494-14b2b43b027f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-volume_attachments/7192b9ad-aaec-4d78-a5f1-5606584dc998" status: 202 len: 0 microversion: 2.1 time: 0.213058 Jun 22 12:05:56.667951 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 615/1179] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 12:05:56 2022] DELETE /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-volume_attachments/7192b9ad-aaec-4d78-a5f1-5606584dc998 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:05:56.677510 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-28dc3d55-0e2a-49c1-a5fb-176f272e801b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:05:56.678859 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-28dc3d55-0e2a-49c1-a5fb-176f272e801b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:05:56.686212 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-28dc3d55-0e2a-49c1-a5fb-176f272e801b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:56.686660 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-28dc3d55-0e2a-49c1-a5fb-176f272e801b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:56.688131 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-28dc3d55-0e2a-49c1-a5fb-176f272e801b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:56.688597 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-28dc3d55-0e2a-49c1-a5fb-176f272e801b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:56.726869 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-28dc3d55-0e2a-49c1-a5fb-176f272e801b tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053903 Jun 22 12:05:56.727683 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 565/1180] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 12:05:56 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:05:57.740299 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0ef5f614-45e7-4342-b8af-00b7d763c789 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:05:57.741288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0ef5f614-45e7-4342-b8af-00b7d763c789 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:05:57.747429 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ef5f614-45e7-4342-b8af-00b7d763c789 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:57.747877 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ef5f614-45e7-4342-b8af-00b7d763c789 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:57.748619 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ef5f614-45e7-4342-b8af-00b7d763c789 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:57.749042 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ef5f614-45e7-4342-b8af-00b7d763c789 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:57.777953 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0ef5f614-45e7-4342-b8af-00b7d763c789 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042533 Jun 22 12:05:57.778543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 616/1181] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 12:05:57 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 12:05:57.834287 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-36493e4d-f196-4cb7-8cfa-27f4110c87ed tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:05:57.834788 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-36493e4d-f196-4cb7-8cfa-27f4110c87ed tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:05:57.841706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36493e4d-f196-4cb7-8cfa-27f4110c87ed tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:57.842146 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36493e4d-f196-4cb7-8cfa-27f4110c87ed tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:57.842883 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36493e4d-f196-4cb7-8cfa-27f4110c87ed tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:57.843307 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-36493e4d-f196-4cb7-8cfa-27f4110c87ed tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:57.867183 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-36493e4d-f196-4cb7-8cfa-27f4110c87ed tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 12:05:57.939187 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-36493e4d-f196-4cb7-8cfa-27f4110c87ed tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 204 len: 0 microversion: 2.1 time: 0.108480 Jun 22 12:05:57.939842 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 566/1182] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:05:57 2022] DELETE /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 12:05:57.949125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-d037719f-5090-43ea-9681-8ec3ae2d69ee tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:05:57.949729 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-d037719f-5090-43ea-9681-8ec3ae2d69ee tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:05:57.955905 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d037719f-5090-43ea-9681-8ec3ae2d69ee tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:57.956362 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d037719f-5090-43ea-9681-8ec3ae2d69ee tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:57.957129 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d037719f-5090-43ea-9681-8ec3ae2d69ee tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:57.957566 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-d037719f-5090-43ea-9681-8ec3ae2d69ee tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:58.086735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-d037719f-5090-43ea-9681-8ec3ae2d69ee tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:05:58.094180 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-d037719f-5090-43ea-9681-8ec3ae2d69ee tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1680 microversion: 2.1 time: 0.149988 Jun 22 12:05:58.094735 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 617/1183] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:05:57 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:05:59.112032 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-24338ed8-ea93-4131-bf4f-c7f76304d600 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:05:59.112679 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-24338ed8-ea93-4131-bf4f-c7f76304d600 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:05:59.119146 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-24338ed8-ea93-4131-bf4f-c7f76304d600 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:59.119617 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-24338ed8-ea93-4131-bf4f-c7f76304d600 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:59.120495 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-24338ed8-ea93-4131-bf4f-c7f76304d600 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:05:59.120926 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-24338ed8-ea93-4131-bf4f-c7f76304d600 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:05:59.248506 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-24338ed8-ea93-4131-bf4f-c7f76304d600 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:05:59.255808 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-24338ed8-ea93-4131-bf4f-c7f76304d600 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1680 microversion: 2.1 time: 0.148028 Jun 22 12:05:59.256359 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 567/1184] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:05:59 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:06:00.273527 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-eb188fc4-4b83-4589-a15d-69d1937a1a2a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:00.274394 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-eb188fc4-4b83-4589-a15d-69d1937a1a2a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:00.281336 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb188fc4-4b83-4589-a15d-69d1937a1a2a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:00.281780 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb188fc4-4b83-4589-a15d-69d1937a1a2a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:00.282540 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb188fc4-4b83-4589-a15d-69d1937a1a2a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:00.282971 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-eb188fc4-4b83-4589-a15d-69d1937a1a2a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:00.408276 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-eb188fc4-4b83-4589-a15d-69d1937a1a2a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:06:00.415976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-eb188fc4-4b83-4589-a15d-69d1937a1a2a tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1680 microversion: 2.1 time: 0.146291 Jun 22 12:06:00.418298 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 618/1185] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:06:00 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:06:01.040019 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-6d12431a-8271-42f7-8566-ce548a93fd3c req-b45a0593-c51c-44bf-bdc4-acf6e5429c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc", "name": "network-vif-deleted", "tag": "afac9a9e-a0ac-4883-bc25-183ab45d03e1"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:06:01.050487 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-6d12431a-8271-42f7-8566-ce548a93fd3c req-b45a0593-c51c-44bf-bdc4-acf6e5429c91 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:01.050915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-6d12431a-8271-42f7-8566-ce548a93fd3c req-b45a0593-c51c-44bf-bdc4-acf6e5429c91 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:01.062234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-6d12431a-8271-42f7-8566-ce548a93fd3c req-b45a0593-c51c-44bf-bdc4-acf6e5429c91 service nova] Creating event network-vif-deleted:afac9a9e-a0ac-4883-bc25-183ab45d03e1 for instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc on hv-cinder-83697 Jun 22 12:06:01.067262 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-6d12431a-8271-42f7-8566-ce548a93fd3c req-b45a0593-c51c-44bf-bdc4-acf6e5429c91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030765 Jun 22 12:06:01.068470 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 568/1186] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:01.434842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:01.435590 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:01.443280 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:01.443757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:01.444521 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:01.445144 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:01.479422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:01.479897 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:01.480345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lazy-loading 'fault' on Instance uuid 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 12:06:01.525296 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d34a97831f4a7c885ebe64aecb3669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897ec8bf954c41648da9cac00bc44749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:06:01.535931 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2d1a911d-5e66-4e84-9c56-e0992f23a723 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 200 len: 1331 microversion: 2.1 time: 0.105711 Jun 22 12:06:01.537039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 619/1187] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:06:01 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:06:02.553594 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:02.554277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:02.560518 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:02.560962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:02.561709 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:02.562134 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:02.576744 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc HTTP/1.1 Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:06:02.578559 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:02.580328 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc'} Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:02.581281 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:02.582892 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:02.584379 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:02.584379 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-142e68fe-0b17-4d58-82d2-4b35980abd19 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 404 len: 111 microversion: 2.1 time: 0.030970 Jun 22 12:06:02.584379 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 569/1188] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:06:02 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:02.590288 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0275c477-ee96-48cd-b708-55547426cd45 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '.version_select at 0x7f3ea822b3a0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:02.606870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0275c477-ee96-48cd-b708-55547426cd45 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420369224" status: 202 len: 0 microversion: 2.1 time: 0.021070 Jun 22 12:06:02.607435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 620/1189] 10.222.0.36 () {58 vars in 1220 bytes} [Wed Jun 22 12:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420369224 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:06:04.322303 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:04.323286 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:04.329689 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:04.330129 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:04.330880 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:04.331310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:04.345067 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc HTTP/1.1 Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:06:04.346593 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.348277 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc'} Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:04.349207 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.350684 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.352507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:04.352507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-931c61fd-e6ae-4360-a29f-f25ce42d9ace tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 404 len: 111 microversion: 2.1 time: 0.029502 Jun 22 12:06:04.352507 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 570/1190] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:06:04 2022] DELETE /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:04.356548 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:04.357162 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:04.363679 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:04.364128 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:04.364888 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:04.365325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:04.378047 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc HTTP/1.1 Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:06:04.379700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.381370 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc'} Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:04.382543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. Jun 22 12:06:04.384083 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:04.386225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance 2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:04.386225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-9f9c066b-ed6b-4dfe-8ef3-6e89d0570ac5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc" status: 404 len: 111 microversion: 2.1 time: 0.028766 Jun 22 12:06:04.386225 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 621/1191] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:06:04 2022] GET /compute/v2.1/servers/2c7b9eeb-5455-4678-a53f-e5f4aa06d0bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:05.512080 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:05.512571 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:05.518955 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:05.519419 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:05.520158 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:05.520608 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:05.533864 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 HTTP/1.1 Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:06:05.535389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.536853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'c3d5f19a-cb48-42bb-a04d-07d266334096'} Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:05.537666 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.539285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.541062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:05.541062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-68c306b0-5439-4917-8d00-9fcf48ca51a5 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 404 len: 111 microversion: 2.1 time: 0.029075 Jun 22 12:06:05.541062 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 571/1192] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:06:05 2022] DELETE /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:05.544965 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:05.545576 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: c3d5f19a-cb48-42bb-a04d-07d266334096] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:05.551763 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:05.552210 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:05.552970 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:05.553396 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:05.566882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 HTTP/1.1 Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:06:05.568407 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.570020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'c3d5f19a-cb48-42bb-a04d-07d266334096'} Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:05.571118 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. Jun 22 12:06:05.573333 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.574715 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance c3d5f19a-cb48-42bb-a04d-07d266334096 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:05.574715 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-73236a38-3e73-49d2-932a-7dddee1f03e6 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096" status: 404 len: 111 microversion: 2.1 time: 0.028668 Jun 22 12:06:05.574715 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 622/1193] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:06:05 2022] GET /compute/v2.1/servers/c3d5f19a-cb48-42bb-a04d-07d266334096 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:05.578404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:05.578889 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:05.584758 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:05.585189 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:05.585934 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:05.586359 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:05.599663 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 HTTP/1.1 Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:06:05.601155 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.602740 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': 'bae2dce9-30b8-4149-b435-985af792f311'} Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:05.603982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.605255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.608043 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:05.608043 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-bafe7514-6b04-4a15-9979-358b4d305dc7 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 404 len: 111 microversion: 2.1 time: 0.027819 Jun 22 12:06:05.608043 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 572/1194] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:06:05 2022] DELETE /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:05.610508 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:05.611113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: bae2dce9-30b8-4149-b435-985af792f311] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:05.617094 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:05.617532 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:05.618277 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:05.618708 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:05.632130 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 HTTP/1.1 Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:06:05.633622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.635804 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'bae2dce9-30b8-4149-b435-985af792f311'} Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:05.636808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. Jun 22 12:06:05.638588 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:05.640113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance bae2dce9-30b8-4149-b435-985af792f311 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:05.640113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ec3d8411-892d-493d-a75e-65e3661f5cd4 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311" status: 404 len: 111 microversion: 2.1 time: 0.028161 Jun 22 12:06:05.640113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 623/1195] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:06:05 2022] GET /compute/v2.1/servers/bae2dce9-30b8-4149-b435-985af792f311 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 12:06:06.768313 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:06.768813 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:06.775508 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:06.776585 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:06.777356 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:06.777783 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:06.790824 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: DELETE /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b HTTP/1.1 Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:06:06.792415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.794039 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '58808877-ad76-46f6-9d87-ad3620eaa37b'} Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:06.795052 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.796768 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.798422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:06.798422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-55a2895e-b059-4bd6-b2aa-e9b5c47de456 tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 404 len: 111 microversion: 2.1 time: 0.029219 Jun 22 12:06:06.798422 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 573/1196] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:06:06 2022] DELETE /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:06.802409 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:06.803020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] [instance: 58808877-ad76-46f6-9d87-ad3620eaa37b] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:06:06.809541 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:06.809983 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:06.810730 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:06:06.811163 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:06:06.825253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] HTTP exception thrown: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Request method failure captured: Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b HTTP/1.1 Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswPtGi8rVvP8c8q_EfK47erLVdy6LuGSjf1LyntiazTXQlr1EG6g6EcZSLdG-KkQrhmyJ_JIU44xVb9c7BTZ48Z-3xFbI9uS5s4UCy1mLI2X01lXgwsQfaaxagDjGcqwRaL6szXdgAkHMoyDgQhGaK0dscK1N_j1dK395SPVThB8fJk Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:06:06.826750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_897ec8bf954c41648da9cac00bc44749", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/897ec8bf954c41648da9cac00bc44749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 897ec8bf954c41648da9cac00bc44749 Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439018862 Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: f2d34a97831f4a7c885ebe64aecb3669 Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-AttachVolumeNegativeTest-439018862-project Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.828471 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '58808877-ad76-46f6-9d87-ad3620eaa37b'} Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:06.829515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. Jun 22 12:06:06.831023 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:06.832543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] Returning 404 to user: Instance 58808877-ad76-46f6-9d87-ad3620eaa37b could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:06.832543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2fe19d73-8fa3-4e4d-9c91-963c7001b09f tempest-AttachVolumeNegativeTest-439018862 tempest-AttachVolumeNegativeTest-439018862-project] 10.222.0.36 "GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b" status: 404 len: 111 microversion: 2.1 time: 0.029473 Jun 22 12:06:06.832543 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 624/1197] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:06:06 2022] GET /compute/v2.1/servers/58808877-ad76-46f6-9d87-ad3620eaa37b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 12:06:11.123394 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-70b009f8-3643-457b-9e6d-9f313fe86636 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Action: 'create', calling method: .version_select at 0x7f3ea8375280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-476911058"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:06:11.399213 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-70b009f8-3643-457b-9e6d-9f313fe86636 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.384947 Jun 22 12:06:11.399908 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 574/1198] 10.222.0.36 () {60 vars in 1154 bytes} [Wed Jun 22 12:06:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 387 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 12:06:11.411744 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b5d2226e-f98c-49f1-8f3a-73c5c335c773 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea80b55e0>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:11.461069 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b5d2226e-f98c-49f1-8f3a-73c5c335c773 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f" status: 200 len: 344 microversion: 2.1 time: 0.053336 Jun 22 12:06:11.461630 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 625/1199] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 12:06:11 2022] GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:12.473976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-5c98f669-00f5-4696-af1d-abdc53bd84c6 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea8356670>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:12.531452 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-5c98f669-00f5-4696-af1d-abdc53bd84c6 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f" status: 200 len: 345 microversion: 2.1 time: 0.061472 Jun 22 12:06:12.532015 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 575/1200] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 12:06:12 2022] GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:12.544919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-b849cc17-186d-4007-ba8e-89aedc039107 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Action: 'create', calling method: .version_select at 0x7f3ea2fdca60>, body: {"snapshot": {"volume_id": "4ac86e23-ac40-4b4b-823f-c2a902ba6d6f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-400555394"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:06:12.685726 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-b849cc17-186d-4007-ba8e-89aedc039107 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.146081 Jun 22 12:06:12.686300 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 626/1201] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Jun 22 12:06:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:12.696255 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-00fa7c6f-7ef5-41ff-9222-a07aaa9a43cc tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea8329af0>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:12.726449 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-00fa7c6f-7ef5-41ff-9222-a07aaa9a43cc tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 200 len: 286 microversion: 2.1 time: 0.033949 Jun 22 12:06:12.726958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 576/1202] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 12:06:12 2022] GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:12.736861 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e3e1116b-d9b4-4909-9ceb-3fa8fd3b96ae tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea2fdc700>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:12.765674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e3e1116b-d9b4-4909-9ceb-3fa8fd3b96ae tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032721 Jun 22 12:06:12.766231 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 627/1203] 10.222.0.36 () {58 vars in 1139 bytes} [Wed Jun 22 12:06:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:12.777090 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-e91c229d-6e71-4eb5-bb2b-cd07d3423ee1 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea835e700>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:12.804983 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-e91c229d-6e71-4eb5-bb2b-cd07d3423ee1 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 200 len: 286 microversion: 2.1 time: 0.032509 Jun 22 12:06:12.805545 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 577/1204] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 12:06:12 2022] GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:13.816808 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c698f875-8c5e-4b02-812d-973648dae8e1 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea81d1d30>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:13.846119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c698f875-8c5e-4b02-812d-973648dae8e1 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 200 len: 286 microversion: 2.1 time: 0.033858 Jun 22 12:06:13.846695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 628/1205] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 12:06:13 2022] GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:14.858853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-225deff4-0e06-4346-badd-9c210554e7d6 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea84b93a0>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:14.887794 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-225deff4-0e06-4346-badd-9c210554e7d6 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 200 len: 286 microversion: 2.1 time: 0.033134 Jun 22 12:06:14.888334 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 578/1206] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 12:06:14 2022] GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:15.900208 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0553afd6-8fa5-4bd9-bbf3-aa1f75a06132 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea806ba60>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:15.929700 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0553afd6-8fa5-4bd9-bbf3-aa1f75a06132 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 200 len: 286 microversion: 2.1 time: 0.034052 Jun 22 12:06:15.930259 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 629/1207] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 12:06:15 2022] GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:16.939257 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:06:16.940029 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:06:16.949245 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-f9ee5e4a-b3e3-4b6b-8d73-c0347c13986d tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea8481550>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:16.979648 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-f9ee5e4a-b3e3-4b6b-8d73-c0347c13986d tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 200 len: 287 microversion: 2.1 time: 0.041563 Jun 22 12:06:16.980238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 579/1208] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 12:06:16 2022] GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:16.987257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:06:16.988072 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:06:16.992292 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-562d1a70-20d6-4847-a06a-36c9eec75002 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea2f8de50>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:17.049603 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-562d1a70-20d6-4847-a06a-36c9eec75002 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 202 len: 0 microversion: 2.1 time: 0.063066 Jun 22 12:06:17.050167 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 630/1209] 10.222.0.36 () {58 vars in 1253 bytes} [Wed Jun 22 12:06:16 2022] DELETE /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:06:17.058929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-0c460e49-2520-4826-933a-4e120c68c6dc tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea835e700>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:17.087927 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-0c460e49-2520-4826-933a-4e120c68c6dc tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 200 len: 286 microversion: 2.1 time: 0.033421 Jun 22 12:06:17.088476 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 580/1210] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 12:06:17 2022] GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:18.100018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-df0b4373-e2fc-4a90-bccd-83165a672b15 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea82e2940>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:18.123712 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-df0b4373-e2fc-4a90-bccd-83165a672b15 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] HTTP exception thrown: Snapshot 5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 could not be found. Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-df0b4373-e2fc-4a90-bccd-83165a672b15 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Request method failure captured: Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 HTTP/1.1 Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswWyeUYV5_vgROV0QkPRXN63XGCJrVQ-PVJMiwlsDYMHjK-OHxQ7NUMz4fxcwIMXcWn79SX3Pv-uGAOflZMsZyD03wLy9UoIdclvOR6pADRqtfK0ibIOoEK-xKO8GklMWOFoiVktufHvbYqc61SXOKS951cjJyOu9c2K4eHbC7Fg-4Y Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 509e8386f2294976a3dee85c162c6111 Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:06:18.125923 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/509e8386f2294976a3dee85c162c6111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/509e8386f2294976a3dee85c162c6111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_509e8386f2294976a3dee85c162c6111", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/509e8386f2294976a3dee85c162c6111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 509e8386f2294976a3dee85c162c6111 Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesSnapshotsTestJSON-1357001195-project Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: f81832aafe4f4ef89607c30c0423e553 Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1357001195-project Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Snapshot 5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 could not be found. Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '5d1e459a-f3d7-4f0a-ac4f-25e514f34c32'} Jun 22 12:06:18.127564 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 could not be found. (HTTP 404) (Request-ID: req-4dabdcfb-70b4-4140-a85a-c80b939d71bc) Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:18.128674 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 12:06:18.130159 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 could not be found. Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 12:06:18.132139 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 could not be found. Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 could not be found. Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-df0b4373-e2fc-4a90-bccd-83165a672b15 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Returning 404 to user: Snapshot 5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:18.133724 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-df0b4373-e2fc-4a90-bccd-83165a672b15 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32" status: 404 len: 111 microversion: 2.1 time: 0.031666 Jun 22 12:06:18.135253 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 631/1211] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 12:06:18 2022] GET /compute/v2.1/os-snapshots/5d1e459a-f3d7-4f0a-ac4f-25e514f34c32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:18.136676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-73079bef-a7ad-4963-8d8c-c725aa42c13e tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea84b93a0>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:18.196200 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-73079bef-a7ad-4963-8d8c-c725aa42c13e tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f" status: 202 len: 0 microversion: 2.1 time: 0.063834 Jun 22 12:06:18.196826 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 581/1212] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 12:06:18 2022] DELETE /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 12:06:18.206426 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2cf740b1-4cc9-48e5-9f5c-28ba4940ce1b tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea82e2040>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:18.254085 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2cf740b1-4cc9-48e5-9f5c-28ba4940ce1b tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f" status: 200 len: 344 microversion: 2.1 time: 0.051288 Jun 22 12:06:18.254769 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 632/1213] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 12:06:18 2022] GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:06:19.267138 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fc875136-01a9-490c-91c8-b0788cdbfb8a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea8609310>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:19.297218 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-fc875136-01a9-490c-91c8-b0788cdbfb8a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] HTTP exception thrown: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fc875136-01a9-490c-91c8-b0788cdbfb8a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Request method failure captured: Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f HTTP/1.1 Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswWyeUYV5_vgROV0QkPRXN63XGCJrVQ-PVJMiwlsDYMHjK-OHxQ7NUMz4fxcwIMXcWn79SX3Pv-uGAOflZMsZyD03wLy9UoIdclvOR6pADRqtfK0ibIOoEK-xKO8GklMWOFoiVktufHvbYqc61SXOKS951cjJyOu9c2K4eHbC7Fg-4Y Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 509e8386f2294976a3dee85c162c6111 Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:06:19.299210 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/509e8386f2294976a3dee85c162c6111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/509e8386f2294976a3dee85c162c6111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_509e8386f2294976a3dee85c162c6111", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/509e8386f2294976a3dee85c162c6111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 509e8386f2294976a3dee85c162c6111 Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-VolumesSnapshotsTestJSON-1357001195-project Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f81832aafe4f4ef89607c30c0423e553 Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1357001195-project Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '4ac86e23-ac40-4b4b-823f-c2a902ba6d6f'} Jun 22 12:06:19.300964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. (HTTP 404) (Request-ID: req-7a393bf3-2c70-44fe-9b5f-37e22ce73450) Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.301860 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 12:06:19.303041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 12:06:19.304241 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-fc875136-01a9-490c-91c8-b0788cdbfb8a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Returning 404 to user: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-fc875136-01a9-490c-91c8-b0788cdbfb8a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f" status: 404 len: 109 microversion: 2.1 time: 0.037823 Jun 22 12:06:19.305461 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 582/1214] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 12:06:19 2022] GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:19.315401 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-771c7c5d-f0e5-4845-b222-579ab4a5fcd9 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea8f7c670>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:19.343268 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-771c7c5d-f0e5-4845-b222-579ab4a5fcd9 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] HTTP exception thrown: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-771c7c5d-f0e5-4845-b222-579ab4a5fcd9 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Request method failure captured: Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: DELETE /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f HTTP/1.1 Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswWyeUYV5_vgROV0QkPRXN63XGCJrVQ-PVJMiwlsDYMHjK-OHxQ7NUMz4fxcwIMXcWn79SX3Pv-uGAOflZMsZyD03wLy9UoIdclvOR6pADRqtfK0ibIOoEK-xKO8GklMWOFoiVktufHvbYqc61SXOKS951cjJyOu9c2K4eHbC7Fg-4Y Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: 509e8386f2294976a3dee85c162c6111 Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:06:19.345223 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/509e8386f2294976a3dee85c162c6111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/509e8386f2294976a3dee85c162c6111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_509e8386f2294976a3dee85c162c6111", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/509e8386f2294976a3dee85c162c6111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: 509e8386f2294976a3dee85c162c6111 Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesSnapshotsTestJSON-1357001195-project Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: f81832aafe4f4ef89607c30c0423e553 Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1357001195-project Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': '4ac86e23-ac40-4b4b-823f-c2a902ba6d6f'} Jun 22 12:06:19.346839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. (HTTP 404) (Request-ID: req-985dad9d-90cb-4ac8-a8d3-8c1026dd4bc8) Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.347848 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 12:06:19.349450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 12:06:19.350919 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-771c7c5d-f0e5-4845-b222-579ab4a5fcd9 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Returning 404 to user: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:19.352390 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-771c7c5d-f0e5-4845-b222-579ab4a5fcd9 tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f" status: 404 len: 109 microversion: 2.1 time: 0.035525 Jun 22 12:06:19.353436 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 633/1215] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 12:06:19 2022] DELETE /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:19.359139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-571b6061-e491-4a8b-87e4-584a25f1892a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Calling method '.version_select at 0x7f3ea84b9a60>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:06:19.385635 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-571b6061-e491-4a8b-87e4-584a25f1892a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] HTTP exception thrown: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-571b6061-e491-4a8b-87e4-584a25f1892a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Request method failure captured: Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f HTTP/1.1 Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswWyeUYV5_vgROV0QkPRXN63XGCJrVQ-PVJMiwlsDYMHjK-OHxQ7NUMz4fxcwIMXcWn79SX3Pv-uGAOflZMsZyD03wLy9UoIdclvOR6pADRqtfK0ibIOoEK-xKO8GklMWOFoiVktufHvbYqc61SXOKS951cjJyOu9c2K4eHbC7Fg-4Y Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: 509e8386f2294976a3dee85c162c6111 Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:06:19.387610 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/509e8386f2294976a3dee85c162c6111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/509e8386f2294976a3dee85c162c6111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_509e8386f2294976a3dee85c162c6111", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/509e8386f2294976a3dee85c162c6111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: 509e8386f2294976a3dee85c162c6111 Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1357001195 Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-VolumesSnapshotsTestJSON-1357001195-project Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: f81832aafe4f4ef89607c30c0423e553 Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1357001195-project Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '4ac86e23-ac40-4b4b-823f-c2a902ba6d6f'} Jun 22 12:06:19.389217 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. (HTTP 404) (Request-ID: req-e5a801d1-62ef-49a2-afce-41a0cfeb13d9) Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.390214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 12:06:19.391699 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 12:06:19.393968 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-571b6061-e491-4a8b-87e4-584a25f1892a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] Returning 404 to user: Volume 4ac86e23-ac40-4b4b-823f-c2a902ba6d6f could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-571b6061-e491-4a8b-87e4-584a25f1892a tempest-VolumesSnapshotsTestJSON-1357001195 tempest-VolumesSnapshotsTestJSON-1357001195-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f" status: 404 len: 109 microversion: 2.1 time: 0.033608 Jun 22 12:06:19.396079 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 583/1216] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 12:06:19 2022] GET /compute/v2.1/os-volumes/4ac86e23-ac40-4b4b-823f-c2a902ba6d6f => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:06:58.445186 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:06:58.445764 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Wed Jun 22 12:06:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:06:58.921907 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:06:58.922404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 12:06:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:07:07.152580 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:07:07.153175 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 12:07:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:07:17.305173 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1505281243", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "networks": [{"uuid": "6e2bd265-a092-4567-8f8c-c9de77f24de4"}]}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:07:17.356635 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.network.neutron [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] validate_networks() for [('6e2bd265-a092-4567-8f8c-c9de77f24de4', None, None, None, None, None)] {{(pid=129528) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 12:07:17.697691 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Flavor limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 12:07:17.698112 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Image limits 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 12:07:17.698582 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Flavor pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 12:07:17.698987 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Image pref 0:0:0 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 12:07:17.699415 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.virt.hardware [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129528) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 12:07:17.708912 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:17.709354 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:17.710152 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:17.710583 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:17.727473 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Getting quotas for project e10970e971fb4b59bc2a5b816a2b376b. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:07:17.731285 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.quota [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Getting quotas for user 8138ccacb8e24c7f8c68d954d54baad7 and project e10970e971fb4b59bc2a5b816a2b376b. Resources: {'instances', 'cores', 'ram'} {{(pid=129528) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:07:17.741969 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Going to run 1 instances... {{(pid=129528) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 12:07:17.744235 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129528) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 12:07:17.789515 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c925128c-b51e-4736-ba92-b7e665f3c98c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489629 Jun 22 12:07:17.790143 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 634/1217] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 12:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 12:07:17.801135 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-eb837747-e95c-4fea-b4b2-33cae0bc487c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:17.801736 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-eb837747-e95c-4fea-b4b2-33cae0bc487c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:17.854354 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-eb837747-e95c-4fea-b4b2-33cae0bc487c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:17.861974 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-eb837747-e95c-4fea-b4b2-33cae0bc487c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1219 microversion: 2.1 time: 0.065587 Jun 22 12:07:17.862538 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 584/1218] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:17 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:18.879584 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-8215b842-2038-4d1b-86b1-c8f927df6504 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:18.880203 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-8215b842-2038-4d1b-86b1-c8f927df6504 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:18.886345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8215b842-2038-4d1b-86b1-c8f927df6504 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:18.886912 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8215b842-2038-4d1b-86b1-c8f927df6504 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:18.887870 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8215b842-2038-4d1b-86b1-c8f927df6504 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:18.888302 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-8215b842-2038-4d1b-86b1-c8f927df6504 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:18.953007 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-8215b842-2038-4d1b-86b1-c8f927df6504 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:18.960794 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-8215b842-2038-4d1b-86b1-c8f927df6504 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1277 microversion: 2.1 time: 0.085618 Jun 22 12:07:18.961340 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 635/1219] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:18 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:19.978193 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-871c96e5-e81f-4589-a2ef-5e87658b0b5e tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:19.978901 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-871c96e5-e81f-4589-a2ef-5e87658b0b5e tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:19.988065 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-871c96e5-e81f-4589-a2ef-5e87658b0b5e tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:19.988855 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-871c96e5-e81f-4589-a2ef-5e87658b0b5e tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:19.990285 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-871c96e5-e81f-4589-a2ef-5e87658b0b5e tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:19.990936 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-871c96e5-e81f-4589-a2ef-5e87658b0b5e tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:20.111105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-9dc7949e-3545-4d97-b29f-4b93292d9fb2 req-ca95c752-5985-4517-8811-f3c60b6df062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb20b4cf-5441-4985-b352-4e35c0622b1e", "tag": "6294d6b9-9a1e-44ba-9c4c-a7c010f50423"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:07:20.124292 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-9dc7949e-3545-4d97-b29f-4b93292d9fb2 req-ca95c752-5985-4517-8811-f3c60b6df062 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:20.124713 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-9dc7949e-3545-4d97-b29f-4b93292d9fb2 req-ca95c752-5985-4517-8811-f3c60b6df062 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:20.138176 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-871c96e5-e81f-4589-a2ef-5e87658b0b5e tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:20.143450 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-9dc7949e-3545-4d97-b29f-4b93292d9fb2 req-ca95c752-5985-4517-8811-f3c60b6df062 service nova] Creating event network-changed:6294d6b9-9a1e-44ba-9c4c-a7c010f50423 for instance bb20b4cf-5441-4985-b352-4e35c0622b1e on hv-cinder-83697 Jun 22 12:07:20.148109 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-9dc7949e-3545-4d97-b29f-4b93292d9fb2 req-ca95c752-5985-4517-8811-f3c60b6df062 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041748 Jun 22 12:07:20.148691 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 636/1220] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:07:20.149443 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-871c96e5-e81f-4589-a2ef-5e87658b0b5e tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1319 microversion: 2.1 time: 0.174391 Jun 22 12:07:20.150088 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 585/1221] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:19 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:21.166950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-c2a4389c-f987-438b-92d8-3b9dc32fd35c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:21.167676 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-c2a4389c-f987-438b-92d8-3b9dc32fd35c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:21.173798 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c2a4389c-f987-438b-92d8-3b9dc32fd35c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:21.174238 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c2a4389c-f987-438b-92d8-3b9dc32fd35c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:21.174979 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c2a4389c-f987-438b-92d8-3b9dc32fd35c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:21.175435 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-c2a4389c-f987-438b-92d8-3b9dc32fd35c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:21.302416 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-c2a4389c-f987-438b-92d8-3b9dc32fd35c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:21.309756 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-c2a4389c-f987-438b-92d8-3b9dc32fd35c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1319 microversion: 2.1 time: 0.147477 Jun 22 12:07:21.310336 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 637/1222] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:21 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:22.326686 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-832ae702-da46-4654-8a95-1c15f1d32609 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:22.327840 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-832ae702-da46-4654-8a95-1c15f1d32609 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:22.334352 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-832ae702-da46-4654-8a95-1c15f1d32609 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:22.334797 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-832ae702-da46-4654-8a95-1c15f1d32609 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:22.335587 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-832ae702-da46-4654-8a95-1c15f1d32609 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:22.336017 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-832ae702-da46-4654-8a95-1c15f1d32609 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:22.462776 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-832ae702-da46-4654-8a95-1c15f1d32609 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:22.470088 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-832ae702-da46-4654-8a95-1c15f1d32609 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1319 microversion: 2.1 time: 0.147348 Jun 22 12:07:22.470639 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 586/1223] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:22 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:23.487194 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e6d15bd3-5a44-4c9d-bd6c-bf59673b1808 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:23.487839 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e6d15bd3-5a44-4c9d-bd6c-bf59673b1808 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:23.494246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6d15bd3-5a44-4c9d-bd6c-bf59673b1808 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:23.494681 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6d15bd3-5a44-4c9d-bd6c-bf59673b1808 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:23.495455 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6d15bd3-5a44-4c9d-bd6c-bf59673b1808 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:23.495882 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e6d15bd3-5a44-4c9d-bd6c-bf59673b1808 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:23.619739 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-e6d15bd3-5a44-4c9d-bd6c-bf59673b1808 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:23.627653 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e6d15bd3-5a44-4c9d-bd6c-bf59673b1808 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1319 microversion: 2.1 time: 0.144826 Jun 22 12:07:23.628208 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 638/1224] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:23 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:24.644995 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-681420d1-9864-4e25-9678-3755110b3728 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:24.645604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-681420d1-9864-4e25-9678-3755110b3728 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:24.652583 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-681420d1-9864-4e25-9678-3755110b3728 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:24.653035 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-681420d1-9864-4e25-9678-3755110b3728 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:24.653794 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-681420d1-9864-4e25-9678-3755110b3728 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:24.654230 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-681420d1-9864-4e25-9678-3755110b3728 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:24.781490 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-681420d1-9864-4e25-9678-3755110b3728 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:24.788853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-681420d1-9864-4e25-9678-3755110b3728 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1319 microversion: 2.1 time: 0.147671 Jun 22 12:07:24.789408 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 587/1225] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:24 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:25.806114 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6269141e-5390-4429-92a7-0309695c72c8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:25.806869 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6269141e-5390-4429-92a7-0309695c72c8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:25.813345 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6269141e-5390-4429-92a7-0309695c72c8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:25.813801 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6269141e-5390-4429-92a7-0309695c72c8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:25.814559 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6269141e-5390-4429-92a7-0309695c72c8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:25.815002 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6269141e-5390-4429-92a7-0309695c72c8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:25.831890 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-3dbb9694-8d28-4faf-a5ce-4e99e4090b5c req-977569ce-fda1-415d-954b-49050c14803d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb20b4cf-5441-4985-b352-4e35c0622b1e", "name": "network-vif-plugged", "status": "completed", "tag": "6294d6b9-9a1e-44ba-9c4c-a7c010f50423"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:07:25.843199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-3dbb9694-8d28-4faf-a5ce-4e99e4090b5c req-977569ce-fda1-415d-954b-49050c14803d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:25.844095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-3dbb9694-8d28-4faf-a5ce-4e99e4090b5c req-977569ce-fda1-415d-954b-49050c14803d service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:25.855232 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-3dbb9694-8d28-4faf-a5ce-4e99e4090b5c req-977569ce-fda1-415d-954b-49050c14803d service nova] Creating event network-vif-plugged:6294d6b9-9a1e-44ba-9c4c-a7c010f50423 for instance bb20b4cf-5441-4985-b352-4e35c0622b1e on hv-cinder-83697 Jun 22 12:07:25.860609 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-3dbb9694-8d28-4faf-a5ce-4e99e4090b5c req-977569ce-fda1-415d-954b-49050c14803d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Jun 22 12:07:25.861502 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 588/1226] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 12:07:25.948177 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6269141e-5390-4429-92a7-0309695c72c8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:25.957068 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6269141e-5390-4429-92a7-0309695c72c8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1319 microversion: 2.1 time: 0.154766 Jun 22 12:07:25.957614 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 639/1227] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:25 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:26.974714 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-00ceb9d0-545f-48b1-91a8-540152eabb42 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:26.975414 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-00ceb9d0-545f-48b1-91a8-540152eabb42 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:26.981975 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00ceb9d0-545f-48b1-91a8-540152eabb42 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:26.982411 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00ceb9d0-545f-48b1-91a8-540152eabb42 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:26.983154 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00ceb9d0-545f-48b1-91a8-540152eabb42 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:26.983601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-00ceb9d0-545f-48b1-91a8-540152eabb42 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:27.108706 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-00ceb9d0-545f-48b1-91a8-540152eabb42 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:27.116022 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-00ceb9d0-545f-48b1-91a8-540152eabb42 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1319 microversion: 2.1 time: 0.145476 Jun 22 12:07:27.116569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 589/1228] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:26 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:28.133568 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6f35e1da-8797-4667-9c66-70fd3ac66cf5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:07:28.134206 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6f35e1da-8797-4667-9c66-70fd3ac66cf5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:28.136612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:07:28.137256 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=6 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:07:28.142867 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6f35e1da-8797-4667-9c66-70fd3ac66cf5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:28.143281 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6f35e1da-8797-4667-9c66-70fd3ac66cf5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:28.144066 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6f35e1da-8797-4667-9c66-70fd3ac66cf5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:28.144496 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6f35e1da-8797-4667-9c66-70fd3ac66cf5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:28.275886 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6f35e1da-8797-4667-9c66-70fd3ac66cf5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:07:28.283894 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6f35e1da-8797-4667-9c66-70fd3ac66cf5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1507 microversion: 2.1 time: 0.154169 Jun 22 12:07:28.284455 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 640/1229] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:07:28 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:07:49.678038 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-b1766d04-b915-4b5e-a254-857fd3a6629d tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e880a074-3ddc-4b9c-bfa4-5f3d99620940", "device": "/dev/sdb"}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:07:49.679694 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-b1766d04-b915-4b5e-a254-857fd3a6629d tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:07:49.681883 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:07:49.682687 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=14 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:07:49.683293 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=26 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:07:49.689436 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b1766d04-b915-4b5e-a254-857fd3a6629d tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:49.689872 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b1766d04-b915-4b5e-a254-857fd3a6629d tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:49.690615 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b1766d04-b915-4b5e-a254-857fd3a6629d tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:07:49.691041 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-b1766d04-b915-4b5e-a254-857fd3a6629d tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:07:49.946445 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-b1766d04-b915-4b5e-a254-857fd3a6629d tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "POST /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272764 Jun 22 12:07:49.947105 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 590/1230] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 12:07:49 2022] POST /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:08:16.621197 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-1b99ff5b-ad51-44d5-961e-1bf141a5b253 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:16.621757 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-1b99ff5b-ad51-44d5-961e-1bf141a5b253 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:16.623953 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:16.624747 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=34 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:16.630668 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1b99ff5b-ad51-44d5-961e-1bf141a5b253 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:16.631113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1b99ff5b-ad51-44d5-961e-1bf141a5b253 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:16.631982 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1b99ff5b-ad51-44d5-961e-1bf141a5b253 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:16.632417 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-1b99ff5b-ad51-44d5-961e-1bf141a5b253 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:16.712947 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.objects.instance [None req-1b99ff5b-ad51-44d5-961e-1bf141a5b253 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lazy-loading 'services' on Instance uuid bb20b4cf-5441-4985-b352-4e35c0622b1e {{(pid=129528) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 12:08:16.782482 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-1b99ff5b-ad51-44d5-961e-1bf141a5b253 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e/os-volume_attachments/e880a074-3ddc-4b9c-bfa4-5f3d99620940" status: 202 len: 0 microversion: 2.1 time: 0.165035 Jun 22 12:08:16.783064 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 641/1231] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 12:08:16 2022] DELETE /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e/os-volume_attachments/e880a074-3ddc-4b9c-bfa4-5f3d99620940 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:08:17.891676 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:17.892453 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:17.896389 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-1698bab4-f90c-4f92-9a7f-617354931b6f tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:17.896963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1698bab4-f90c-4f92-9a7f-617354931b6f tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:17.904963 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1698bab4-f90c-4f92-9a7f-617354931b6f tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:17.905399 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1698bab4-f90c-4f92-9a7f-617354931b6f tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:17.906143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1698bab4-f90c-4f92-9a7f-617354931b6f tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:17.906569 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-1698bab4-f90c-4f92-9a7f-617354931b6f tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:17.931310 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-1698bab4-f90c-4f92-9a7f-617354931b6f tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Going to try to terminate instance {{(pid=129527) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 12:08:18.005947 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-1698bab4-f90c-4f92-9a7f-617354931b6f tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 204 len: 0 microversion: 2.1 time: 0.115352 Jun 22 12:08:18.006539 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 591/1232] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:08:17 2022] DELETE /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 12:08:18.016218 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-74baeaf8-133f-4ee4-aaf2-d8c78626e755 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:18.016910 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-74baeaf8-133f-4ee4-aaf2-d8c78626e755 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:18.022996 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-74baeaf8-133f-4ee4-aaf2-d8c78626e755 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:18.024088 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-74baeaf8-133f-4ee4-aaf2-d8c78626e755 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:18.025106 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-74baeaf8-133f-4ee4-aaf2-d8c78626e755 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:18.025538 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-74baeaf8-133f-4ee4-aaf2-d8c78626e755 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:18.156657 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-74baeaf8-133f-4ee4-aaf2-d8c78626e755 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:18.164067 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-74baeaf8-133f-4ee4-aaf2-d8c78626e755 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1513 microversion: 2.1 time: 0.152591 Jun 22 12:08:18.164622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 642/1233] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:18 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:19.182929 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-2b833b4f-29ff-4f4e-91c3-bffd27fd2e55 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:19.183658 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-2b833b4f-29ff-4f4e-91c3-bffd27fd2e55 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:19.189965 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b833b4f-29ff-4f4e-91c3-bffd27fd2e55 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:19.190411 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b833b4f-29ff-4f4e-91c3-bffd27fd2e55 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:19.191144 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b833b4f-29ff-4f4e-91c3-bffd27fd2e55 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:19.191596 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-2b833b4f-29ff-4f4e-91c3-bffd27fd2e55 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:19.320831 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-2b833b4f-29ff-4f4e-91c3-bffd27fd2e55 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:19.328158 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-2b833b4f-29ff-4f4e-91c3-bffd27fd2e55 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1513 microversion: 2.1 time: 0.149472 Jun 22 12:08:19.328712 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 592/1234] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:19 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:20.345776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6257a05d-7454-4517-a071-1055f3523964 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:20.346380 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6257a05d-7454-4517-a071-1055f3523964 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:20.353534 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6257a05d-7454-4517-a071-1055f3523964 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:20.353976 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6257a05d-7454-4517-a071-1055f3523964 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:20.354733 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6257a05d-7454-4517-a071-1055f3523964 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:20.355251 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6257a05d-7454-4517-a071-1055f3523964 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:20.417684 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6257a05d-7454-4517-a071-1055f3523964 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:20.425750 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6257a05d-7454-4517-a071-1055f3523964 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 200 len: 1471 microversion: 2.1 time: 0.083750 Jun 22 12:08:20.426143 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-24536df9-aaf8-4972-bd40-a2eba51f2a63 req-726f94a8-b1d9-4b0d-93a8-59648dbbff7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb20b4cf-5441-4985-b352-4e35c0622b1e", "name": "network-vif-deleted", "tag": "6294d6b9-9a1e-44ba-9c4c-a7c010f50423"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:08:20.426775 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 643/1235] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:20 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:20.435964 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-24536df9-aaf8-4972-bd40-a2eba51f2a63 req-726f94a8-b1d9-4b0d-93a8-59648dbbff7e service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:20.436581 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-24536df9-aaf8-4972-bd40-a2eba51f2a63 req-726f94a8-b1d9-4b0d-93a8-59648dbbff7e service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:20.447767 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-24536df9-aaf8-4972-bd40-a2eba51f2a63 req-726f94a8-b1d9-4b0d-93a8-59648dbbff7e service nova] Creating event network-vif-deleted:6294d6b9-9a1e-44ba-9c4c-a7c010f50423 for instance bb20b4cf-5441-4985-b352-4e35c0622b1e on hv-cinder-83697 Jun 22 12:08:20.452680 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-24536df9-aaf8-4972-bd40-a2eba51f2a63 req-726f94a8-b1d9-4b0d-93a8-59648dbbff7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Jun 22 12:08:20.453351 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 593/1236] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:08:21.442522 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:21.443125 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: bb20b4cf-5441-4985-b352-4e35c0622b1e] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:21.450286 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:21.450725 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:21.451501 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:21.451929 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:21.464725 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.wsgi [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] HTTP exception thrown: Instance bb20b4cf-5441-4985-b352-4e35c0622b1e could not be found. Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Request method failure captured: Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: request: GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e HTTP/1.1 Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept: application/json Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Accept-Encoding: identity Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Connection: close Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Length: 0 Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Content-Type: application/json Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Host: 10.222.0.36 Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Openstack-System-Scope: None Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: User-Agent: python-urllib3/1.26.9 Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Auth-Token: gAAAAABiswXzcnwJyYAUcnXEmMjEaNMeT1D-EbBMG7MHPJ-3sZ8-PV9oikVVXKQHeQK3_NMzjUTMstxFhOJKM4sb4GbMFXhDoaJAmCViBH8YQ0KOjgsgIFlAKiVaM9WzRlj5oAa8N9tbB71fWAYV1Ood9FlXJgeXY3mO30-z_wiZsN50tOe35nU Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Id: None Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Domain-Name: None Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Identity-Status: Confirmed Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Is-Admin-Project: True Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Id: default Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Domain-Name: Default Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Id: e10970e971fb4b59bc2a5b816a2b376b Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1145659631 Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Role: member,reader Jun 22 12:08:21.466322 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Roles: member,reader Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e10970e971fb4b59bc2a5b816a2b376b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e10970e971fb4b59bc2a5b816a2b376b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e10970e971fb4b59bc2a5b816a2b376b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e10970e971fb4b59bc2a5b816a2b376b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant: tempest-VolumesSnapshotTestJSON-1145659631 Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Id: e10970e971fb4b59bc2a5b816a2b376b Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1145659631 Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User: tempest-VolumesSnapshotTestJSON-1145659631-project Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Id: default Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Domain-Name: Default Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Id: 8138ccacb8e24c7f8c68d954d54baad7 Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: X-User-Name: tempest-VolumesSnapshotTestJSON-1145659631-project Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: method: > Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: exception: Instance bb20b4cf-5441-4985-b352-4e35c0622b1e could not be found. Jun 22 12:08:21.468246 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: action_args: {'id': 'bb20b4cf-5441-4985-b352-4e35c0622b1e'} Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb20b4cf-5441-4985-b352-4e35c0622b1e could not be found. Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:08:21.469325 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb20b4cf-5441-4985-b352-4e35c0622b1e could not be found. Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb20b4cf-5441-4985-b352-4e35c0622b1e could not be found. Jun 22 12:08:21.471484 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: ERROR nova.api.openstack.wsgi Jun 22 12:08:21.473020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Returning 404 to user: Instance bb20b4cf-5441-4985-b352-4e35c0622b1e could not be found. {{(pid=129528) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:08:21.473020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-0ae47997-89c1-4d9d-929a-755137a2ad12 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e" status: 404 len: 111 microversion: 2.1 time: 0.028951 Jun 22 12:08:21.473020 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 644/1237] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:21 2022] GET /compute/v2.1/servers/bb20b4cf-5441-4985-b352-4e35c0622b1e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:08:31.250289 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:31.251059 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:31.256234 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-262878293", "imageRef": "2fced3e2-8c50-40e0-af5b-bce42cb991be", "flavorRef": "452", "networks": [{"uuid": "6e2bd265-a092-4567-8f8c-c9de77f24de4"}]}} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:08:31.310618 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.network.neutron [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] validate_networks() for [('6e2bd265-a092-4567-8f8c-c9de77f24de4', None, None, None, None, None)] {{(pid=129527) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 12:08:31.847058 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Flavor limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 12:08:31.847625 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Image limits 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 12:08:31.848095 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Flavor pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 12:08:31.848552 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Image pref 0:0:0 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 12:08:31.848988 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.virt.hardware [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 12:08:31.857710 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:31.858145 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:31.858921 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:31.859343 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:31.876044 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Getting quotas for project e10970e971fb4b59bc2a5b816a2b376b. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 12:08:31.880010 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.quota [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Getting quotas for user 8138ccacb8e24c7f8c68d954d54baad7 and project e10970e971fb4b59bc2a5b816a2b376b. Resources: {'instances', 'cores', 'ram'} {{(pid=129527) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 12:08:31.891765 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Going to run 1 instances... {{(pid=129527) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 12:08:31.894098 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fced3e2-8c50-40e0-af5b-bce42cb991be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 12:08:31.939212 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-a504041e-7eb8-430c-a962-375ce39287ec tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694038 Jun 22 12:08:31.939889 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 594/1238] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 12:08:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 12:08:31.950369 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-2b32f0f6-95db-4613-8a5d-e73ee89498e5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:31.951140 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-2b32f0f6-95db-4613-8a5d-e73ee89498e5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:31.953683 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=8 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:31.954513 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:32.009950 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-2b32f0f6-95db-4613-8a5d-e73ee89498e5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:32.017688 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-2b32f0f6-95db-4613-8a5d-e73ee89498e5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1218 microversion: 2.1 time: 0.071761 Jun 22 12:08:32.018247 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 645/1239] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:31 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:33.035132 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-401fad9d-73e4-49e8-9c23-3a44b90cad3c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:33.035915 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-401fad9d-73e4-49e8-9c23-3a44b90cad3c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:33.042962 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-401fad9d-73e4-49e8-9c23-3a44b90cad3c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:33.043809 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-401fad9d-73e4-49e8-9c23-3a44b90cad3c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:33.044334 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-401fad9d-73e4-49e8-9c23-3a44b90cad3c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:33.044615 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-401fad9d-73e4-49e8-9c23-3a44b90cad3c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:33.105990 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-401fad9d-73e4-49e8-9c23-3a44b90cad3c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:33.113419 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-401fad9d-73e4-49e8-9c23-3a44b90cad3c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1276 microversion: 2.1 time: 0.082791 Jun 22 12:08:33.113981 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 595/1240] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:33 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:34.131371 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-637283ba-6038-441b-b4e1-eeb1558212d8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:34.131992 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-637283ba-6038-441b-b4e1-eeb1558212d8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:34.139876 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-637283ba-6038-441b-b4e1-eeb1558212d8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:34.140255 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-637283ba-6038-441b-b4e1-eeb1558212d8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:34.141063 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-637283ba-6038-441b-b4e1-eeb1558212d8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:34.141644 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-637283ba-6038-441b-b4e1-eeb1558212d8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:34.281774 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-637283ba-6038-441b-b4e1-eeb1558212d8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:34.289220 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-637283ba-6038-441b-b4e1-eeb1558212d8 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.161729 Jun 22 12:08:34.289776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 646/1241] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:34 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:34.408720 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [req-333c7831-6959-4917-9a19-ab54f54f0dab req-933cd8a4-7a7b-422f-9538-e2c629f32a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea1afa2-54b1-4339-9bc2-07c18c6eb44a", "tag": "5819b322-1b32-4f52-a1eb-d6f68abf3b61"}]} {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:08:34.418011 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-333c7831-6959-4917-9a19-ab54f54f0dab req-933cd8a4-7a7b-422f-9538-e2c629f32a0b service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:34.418553 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [req-333c7831-6959-4917-9a19-ab54f54f0dab req-933cd8a4-7a7b-422f-9538-e2c629f32a0b service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:34.429958 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.compute.server_external_events [req-333c7831-6959-4917-9a19-ab54f54f0dab req-933cd8a4-7a7b-422f-9538-e2c629f32a0b service nova] Creating event network-changed:5819b322-1b32-4f52-a1eb-d6f68abf3b61 for instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a on hv-cinder-83697 Jun 22 12:08:34.434631 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [req-333c7831-6959-4917-9a19-ab54f54f0dab req-933cd8a4-7a7b-422f-9538-e2c629f32a0b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029596 Jun 22 12:08:34.435229 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 596/1242] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:08:35.081664 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:08:35.081873 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Wed Jun 22 12:08:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:08:35.307593 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-7b675a2c-5d62-46fa-8c2c-c444a50e2627 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:35.308233 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-7b675a2c-5d62-46fa-8c2c-c444a50e2627 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:35.317776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7b675a2c-5d62-46fa-8c2c-c444a50e2627 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:35.317776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7b675a2c-5d62-46fa-8c2c-c444a50e2627 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:35.317776 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7b675a2c-5d62-46fa-8c2c-c444a50e2627 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:35.318160 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-7b675a2c-5d62-46fa-8c2c-c444a50e2627 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:35.444034 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-7b675a2c-5d62-46fa-8c2c-c444a50e2627 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:35.451315 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-7b675a2c-5d62-46fa-8c2c-c444a50e2627 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.149303 Jun 22 12:08:35.451891 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 647/1243] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:35 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:36.468401 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-4ce8f871-2835-4f8a-91fd-58ce5536ebe9 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:36.469086 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-4ce8f871-2835-4f8a-91fd-58ce5536ebe9 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:36.475199 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4ce8f871-2835-4f8a-91fd-58ce5536ebe9 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:36.475664 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4ce8f871-2835-4f8a-91fd-58ce5536ebe9 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:36.476415 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4ce8f871-2835-4f8a-91fd-58ce5536ebe9 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:36.476838 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-4ce8f871-2835-4f8a-91fd-58ce5536ebe9 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:36.606454 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-4ce8f871-2835-4f8a-91fd-58ce5536ebe9 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:36.614468 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-4ce8f871-2835-4f8a-91fd-58ce5536ebe9 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.150820 Jun 22 12:08:36.615037 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 597/1244] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:36 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:37.633257 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6995cb6d-17fa-4b24-8d6d-f89a1e609fe2 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:37.633866 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6995cb6d-17fa-4b24-8d6d-f89a1e609fe2 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:37.640917 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6995cb6d-17fa-4b24-8d6d-f89a1e609fe2 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:37.641358 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6995cb6d-17fa-4b24-8d6d-f89a1e609fe2 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:37.642113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6995cb6d-17fa-4b24-8d6d-f89a1e609fe2 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:37.642547 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6995cb6d-17fa-4b24-8d6d-f89a1e609fe2 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:37.766842 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-6995cb6d-17fa-4b24-8d6d-f89a1e609fe2 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:37.775922 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6995cb6d-17fa-4b24-8d6d-f89a1e609fe2 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.146390 Jun 22 12:08:37.776625 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 648/1245] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:37 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:38.794382 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-80a41e3b-62a0-4a4f-9184-5c1403efae0c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:38.794994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-80a41e3b-62a0-4a4f-9184-5c1403efae0c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:38.801342 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-80a41e3b-62a0-4a4f-9184-5c1403efae0c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:38.801777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-80a41e3b-62a0-4a4f-9184-5c1403efae0c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:38.802518 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-80a41e3b-62a0-4a4f-9184-5c1403efae0c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:38.802944 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-80a41e3b-62a0-4a4f-9184-5c1403efae0c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:38.926377 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-80a41e3b-62a0-4a4f-9184-5c1403efae0c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:38.934020 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-80a41e3b-62a0-4a4f-9184-5c1403efae0c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.143952 Jun 22 12:08:38.935197 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 598/1246] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:38 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:39.951412 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-ab026c9f-6848-4b37-bd69-c5a2715950cc tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:39.952042 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-ab026c9f-6848-4b37-bd69-c5a2715950cc tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:39.959490 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ab026c9f-6848-4b37-bd69-c5a2715950cc tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:39.959935 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ab026c9f-6848-4b37-bd69-c5a2715950cc tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:39.960689 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ab026c9f-6848-4b37-bd69-c5a2715950cc tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:39.961113 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-ab026c9f-6848-4b37-bd69-c5a2715950cc tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:40.090592 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-ab026c9f-6848-4b37-bd69-c5a2715950cc tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:40.098014 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-ab026c9f-6848-4b37-bd69-c5a2715950cc tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.150495 Jun 22 12:08:40.098577 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 649/1247] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:39 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:41.113898 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-752d50ce-20ad-4dfd-bb34-e41314f7ea9c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:41.114503 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-752d50ce-20ad-4dfd-bb34-e41314f7ea9c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:41.120924 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-752d50ce-20ad-4dfd-bb34-e41314f7ea9c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:41.121366 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-752d50ce-20ad-4dfd-bb34-e41314f7ea9c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:41.122110 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-752d50ce-20ad-4dfd-bb34-e41314f7ea9c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:41.122539 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-752d50ce-20ad-4dfd-bb34-e41314f7ea9c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:41.250060 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-752d50ce-20ad-4dfd-bb34-e41314f7ea9c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:41.257373 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-752d50ce-20ad-4dfd-bb34-e41314f7ea9c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.147316 Jun 22 12:08:41.257938 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 599/1248] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:41 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:42.231934 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell0:SELECT=2 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:42.273943 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3f00dd33-8f67-4b1e-a033-e81332580fd6 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:42.275671 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3f00dd33-8f67-4b1e-a033-e81332580fd6 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:42.281976 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=2 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:42.282889 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell0:SELECT=6 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:08:42.286007 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3f00dd33-8f67-4b1e-a033-e81332580fd6 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:42.286678 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3f00dd33-8f67-4b1e-a033-e81332580fd6 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:42.288016 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3f00dd33-8f67-4b1e-a033-e81332580fd6 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:42.288601 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3f00dd33-8f67-4b1e-a033-e81332580fd6 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:42.365150 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-d9bfdc4c-d5c8-445b-8a28-130c85fcafde req-28c14145-f6dd-471a-8354-3c3d4c292568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea1afa2-54b1-4339-9bc2-07c18c6eb44a", "name": "network-vif-plugged", "status": "completed", "tag": "5819b322-1b32-4f52-a1eb-d6f68abf3b61"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:08:42.373100 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-d9bfdc4c-d5c8-445b-8a28-130c85fcafde req-28c14145-f6dd-471a-8354-3c3d4c292568 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:42.373533 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-d9bfdc4c-d5c8-445b-8a28-130c85fcafde req-28c14145-f6dd-471a-8354-3c3d4c292568 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:42.384140 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-d9bfdc4c-d5c8-445b-8a28-130c85fcafde req-28c14145-f6dd-471a-8354-3c3d4c292568 service nova] Creating event network-vif-plugged:5819b322-1b32-4f52-a1eb-d6f68abf3b61 for instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a on hv-cinder-83697 Jun 22 12:08:42.389405 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-d9bfdc4c-d5c8-445b-8a28-130c85fcafde req-28c14145-f6dd-471a-8354-3c3d4c292568 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162778 Jun 22 12:08:42.389993 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 650/1249] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:08:42.426191 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3f00dd33-8f67-4b1e-a033-e81332580fd6 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:42.433681 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3f00dd33-8f67-4b1e-a033-e81332580fd6 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.163494 Jun 22 12:08:42.434254 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 600/1250] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:42 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 12:08:43.451461 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-cf1bbb91-f0f4-4c93-96ae-19d8bb44a95a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:43.452179 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-cf1bbb91-f0f4-4c93-96ae-19d8bb44a95a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:43.458387 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf1bbb91-f0f4-4c93-96ae-19d8bb44a95a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:43.458831 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf1bbb91-f0f4-4c93-96ae-19d8bb44a95a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:43.459605 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf1bbb91-f0f4-4c93-96ae-19d8bb44a95a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:43.460039 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-cf1bbb91-f0f4-4c93-96ae-19d8bb44a95a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:43.587226 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-cf1bbb91-f0f4-4c93-96ae-19d8bb44a95a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:43.594628 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-cf1bbb91-f0f4-4c93-96ae-19d8bb44a95a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1318 microversion: 2.1 time: 0.148376 Jun 22 12:08:43.595185 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 651/1251] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:43 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:44.611321 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-853286fd-1ee3-4e54-9452-0d3798351292 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:08:44.611891 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-853286fd-1ee3-4e54-9452-0d3798351292 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:44.618273 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-853286fd-1ee3-4e54-9452-0d3798351292 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:44.618712 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-853286fd-1ee3-4e54-9452-0d3798351292 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:44.619493 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-853286fd-1ee3-4e54-9452-0d3798351292 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:44.619925 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-853286fd-1ee3-4e54-9452-0d3798351292 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:44.746388 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-853286fd-1ee3-4e54-9452-0d3798351292 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:08:44.753781 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-853286fd-1ee3-4e54-9452-0d3798351292 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1507 microversion: 2.1 time: 0.146986 Jun 22 12:08:44.754334 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 601/1252] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:08:44 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:08:44.770422 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-6f88224a-aa09-4660-ae57-3fdb52778fba tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1866694-1f05-4142-ba74-ab08959e2848", "device": "/dev/sdb"}} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:08:44.772082 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-6f88224a-aa09-4660-ae57-3fdb52778fba tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:08:44.779884 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6f88224a-aa09-4660-ae57-3fdb52778fba tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:44.780323 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6f88224a-aa09-4660-ae57-3fdb52778fba tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:44.781063 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6f88224a-aa09-4660-ae57-3fdb52778fba tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:08:44.781488 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-6f88224a-aa09-4660-ae57-3fdb52778fba tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:08:45.022018 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-6f88224a-aa09-4660-ae57-3fdb52778fba tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "POST /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254885 Jun 22 12:08:45.022622 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 652/1253] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 12:08:44 2022] POST /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:09:06.353680 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-250d1573-a623-4953-a8fe-530f476c5cb5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:09:06.354179 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-250d1573-a623-4953-a8fe-530f476c5cb5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:09:06.356356 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:06.356979 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG dbcounter [-] [129527] Writing DB stats nova_cell1:SELECT=40 {{(pid=129527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:06.363205 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-250d1573-a623-4953-a8fe-530f476c5cb5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:06.363672 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-250d1573-a623-4953-a8fe-530f476c5cb5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:06.364424 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-250d1573-a623-4953-a8fe-530f476c5cb5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:06.364853 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-250d1573-a623-4953-a8fe-530f476c5cb5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:06.445404 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.objects.instance [None req-250d1573-a623-4953-a8fe-530f476c5cb5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lazy-loading 'services' on Instance uuid 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a {{(pid=129527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 12:09:06.515411 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-250d1573-a623-4953-a8fe-530f476c5cb5 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a/os-volume_attachments/b1866694-1f05-4142-ba74-ab08959e2848" status: 202 len: 0 microversion: 2.1 time: 0.165422 Jun 22 12:09:06.515994 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 602/1254] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 12:09:06 2022] DELETE /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a/os-volume_attachments/b1866694-1f05-4142-ba74-ab08959e2848 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 12:09:07.627036 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-e3509449-2200-4766-96d9-fba7e7d59886 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:09:07.627642 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e3509449-2200-4766-96d9-fba7e7d59886 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:09:07.630202 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_api:SELECT=18 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:07.630863 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG dbcounter [-] [129528] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:07.637166 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e3509449-2200-4766-96d9-fba7e7d59886 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:07.637612 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e3509449-2200-4766-96d9-fba7e7d59886 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:07.638376 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e3509449-2200-4766-96d9-fba7e7d59886 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:07.638823 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-e3509449-2200-4766-96d9-fba7e7d59886 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:07.664395 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-e3509449-2200-4766-96d9-fba7e7d59886 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Going to try to terminate instance {{(pid=129528) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 12:09:07.741105 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-e3509449-2200-4766-96d9-fba7e7d59886 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 204 len: 0 microversion: 2.1 time: 0.117850 Jun 22 12:09:07.741778 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 653/1255] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 12:09:07 2022] DELETE /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:07.750874 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-814c0f9b-f753-481f-a364-9b571d55791c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:09:07.751605 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-814c0f9b-f753-481f-a364-9b571d55791c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:09:07.757777 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-814c0f9b-f753-481f-a364-9b571d55791c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:07.758221 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-814c0f9b-f753-481f-a364-9b571d55791c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:07.758982 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-814c0f9b-f753-481f-a364-9b571d55791c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:07.759450 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-814c0f9b-f753-481f-a364-9b571d55791c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:07.885894 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-814c0f9b-f753-481f-a364-9b571d55791c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:09:07.894179 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-814c0f9b-f753-481f-a364-9b571d55791c tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1513 microversion: 2.1 time: 0.148006 Jun 22 12:09:07.894743 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 603/1256] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:09:07 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:08.912294 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [None req-4448fbc9-018c-4d14-8e01-092ab979c372 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:09:08.912987 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.compute.api [None req-4448fbc9-018c-4d14-8e01-092ab979c372 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129528) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:09:08.920100 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4448fbc9-018c-4d14-8e01-092ab979c372 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:08.920514 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4448fbc9-018c-4d14-8e01-092ab979c372 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:08.921266 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4448fbc9-018c-4d14-8e01-092ab979c372 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:08.921695 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [None req-4448fbc9-018c-4d14-8e01-092ab979c372 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:09.048099 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.policy [None req-4448fbc9-018c-4d14-8e01-092ab979c372 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129528) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:09:09.055561 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [None req-4448fbc9-018c-4d14-8e01-092ab979c372 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1513 microversion: 2.1 time: 0.147627 Jun 22 12:09:09.056119 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 654/1257] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:09:08 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:10.072613 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-3cfdff64-1568-43ca-bfc4-f8af53cabd69 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:09:10.073214 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-3cfdff64-1568-43ca-bfc4-f8af53cabd69 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:09:10.080168 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3cfdff64-1568-43ca-bfc4-f8af53cabd69 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:10.080604 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3cfdff64-1568-43ca-bfc4-f8af53cabd69 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:10.081349 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3cfdff64-1568-43ca-bfc4-f8af53cabd69 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:10.081770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-3cfdff64-1568-43ca-bfc4-f8af53cabd69 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:10.220546 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.policy [None req-3cfdff64-1568-43ca-bfc4-f8af53cabd69 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8138ccacb8e24c7f8c68d954d54baad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10970e971fb4b59bc2a5b816a2b376b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129527) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 12:09:10.238909 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-3cfdff64-1568-43ca-bfc4-f8af53cabd69 tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 200 len: 1513 microversion: 2.1 time: 0.170016 Jun 22 12:09:10.240734 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 604/1258] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:09:10 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:10.288613 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG nova.api.openstack.wsgi [req-10573842-ef50-45cc-8769-88e40159d044 req-8c6e6b29-d80c-45e2-920a-1483a4a51888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea1afa2-54b1-4339-9bc2-07c18c6eb44a", "name": "network-vif-deleted", "tag": "5819b322-1b32-4f52-a1eb-d6f68abf3b61"}]} {{(pid=129528) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 12:09:10.299643 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-10573842-ef50-45cc-8769-88e40159d044 req-8c6e6b29-d80c-45e2-920a-1483a4a51888 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:10.300381 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: DEBUG oslo_concurrency.lockutils [req-10573842-ef50-45cc-8769-88e40159d044 req-8c6e6b29-d80c-45e2-920a-1483a4a51888 service nova] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:10.313402 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.compute.server_external_events [req-10573842-ef50-45cc-8769-88e40159d044 req-8c6e6b29-d80c-45e2-920a-1483a4a51888 service nova] Creating event network-vif-deleted:5819b322-1b32-4f52-a1eb-d6f68abf3b61 for instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a on hv-cinder-83697 Jun 22 12:09:10.318818 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO nova.api.openstack.requestlog [req-10573842-ef50-45cc-8769-88e40159d044 req-8c6e6b29-d80c-45e2-920a-1483a4a51888 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Jun 22 12:09:10.319456 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: [pid: 129528|app: 0|req: 655/1259] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 12:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 12:09:11.257139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Calling method '>' {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 12:09:11.257659 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.compute.api [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] [instance: 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a] Fetching instance by UUID {{(pid=129527) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 12:09:11.264917 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:11.265361 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:11.266106 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 12:09:11.266532 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG oslo_concurrency.lockutils [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Lock "18a4207f-37f5-4279-abf2-4a3e89b4b2e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 12:09:11.281755 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.wsgi [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] HTTP exception thrown: Instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a could not be found. Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Request method failure captured: Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: request: GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a HTTP/1.1 Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept: application/json Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Accept-Encoding: identity Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Connection: close Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Length: 0 Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Content-Type: application/json Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Host: 10.222.0.36 Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Openstack-System-Scope: None Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: User-Agent: python-urllib3/1.26.9 Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Auth-Token: gAAAAABiswXzcnwJyYAUcnXEmMjEaNMeT1D-EbBMG7MHPJ-3sZ8-PV9oikVVXKQHeQK3_NMzjUTMstxFhOJKM4sb4GbMFXhDoaJAmCViBH8YQ0KOjgsgIFlAKiVaM9WzRlj5oAa8N9tbB71fWAYV1Ood9FlXJgeXY3mO30-z_wiZsN50tOe35nU Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Id: None Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Domain-Name: None Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Identity-Status: Confirmed Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Is-Admin-Project: True Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Id: default Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Domain-Name: Default Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Id: e10970e971fb4b59bc2a5b816a2b376b Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1145659631 Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Role: member,reader Jun 22 12:09:11.283390 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Roles: member,reader Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e10970e971fb4b59bc2a5b816a2b376b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e10970e971fb4b59bc2a5b816a2b376b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e10970e971fb4b59bc2a5b816a2b376b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e10970e971fb4b59bc2a5b816a2b376b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant: tempest-VolumesSnapshotTestJSON-1145659631 Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Id: e10970e971fb4b59bc2a5b816a2b376b Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1145659631 Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User: tempest-VolumesSnapshotTestJSON-1145659631-project Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Id: default Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Domain-Name: Default Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Id: 8138ccacb8e24c7f8c68d954d54baad7 Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: X-User-Name: tempest-VolumesSnapshotTestJSON-1145659631-project Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: method: > Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: exception: Instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a could not be found. Jun 22 12:09:11.285238 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: action_args: {'id': '7ea1afa2-54b1-4339-9bc2-07c18c6eb44a'} Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: {{(pid=129527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a could not be found. Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 12:09:11.286403 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a could not be found. Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a could not be found. Jun 22 12:09:11.288139 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: ERROR nova.api.openstack.wsgi Jun 22 12:09:11.289770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: DEBUG nova.api.openstack.wsgi [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] Returning 404 to user: Instance 7ea1afa2-54b1-4339-9bc2-07c18c6eb44a could not be found. {{(pid=129527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 12:09:11.289770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO nova.api.openstack.requestlog [None req-62dd3fb8-7335-45b7-ac8b-6be155a24a2a tempest-VolumesSnapshotTestJSON-1145659631 tempest-VolumesSnapshotTestJSON-1145659631-project] 10.222.0.36 "GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a" status: 404 len: 111 microversion: 2.1 time: 0.031515 Jun 22 12:09:11.289770 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: [pid: 129527|app: 0|req: 605/1260] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 12:09:11 2022] GET /compute/v2.1/servers/7ea1afa2-54b1-4339-9bc2-07c18c6eb44a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 12:10:18.453585 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:10:18.454188 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Wed Jun 22 12:10:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:10:18.930557 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:10:18.931123 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 12:10:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:11:55.089803 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:11:55.090284 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Wed Jun 22 12:11:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:12:16.359254 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:12:16.359993 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Wed Jun 22 12:12:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:12:21.732216 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:12:21.732795 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 12:12:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:13:38.461793 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:13:38.462420 dv-cinder-836973-9-iscsi devstack@n-api.service[129528]: Wed Jun 22 12:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:13:38.939638 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:13:38.940195 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 12:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 12:13:47.163607 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 12:13:47.164243 dv-cinder-836973-9-iscsi devstack@n-api.service[129527]: Wed Jun 22 12:13:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!